Generally speaking, that is how the courts deal with it. It is a matter of taking the perception of the accused into account, but insofar as that perception is reasonable.
I don’t think your suggestion would change how the legislation is interpreted or applied.