Of course you can't have viable free speech unless people are likely to be offended. It simply doesn't otherwise exist. But as far as the more, if I may say, metaphysical question you're asking, is there a right to freedom from hatred, that really depends on one's ultimate philosophy, and I don't know how philosophical you want me to get.
As far as I'm concerned, the rights we have are creations of the law. Apart from that, I don't understand what we're talking about. So if you create a freedom from X, then you have that right. If you don't, you don't have that right. I don't see these things existing in a state of nature. So if the questions you're asking me are at that level, I beg off, because that's not my area.