I think that is a concern, whether it's on that particular issue or on any number of social issues on which Canadians hold very sincere, strongly held views.
If we define hatred too imprecisely, then it does create the risk that it could be used to capture not just the speech or the modes of expression that the Supreme Court has been concerned with, but also specific ideas that we might find repugnant or offensive, and be used to apply hatred in a colloquial sense, as opposed to in a criminal sense, to speech.
That is part of what it means to be in a democratic society: It means being exposed to opposing views.