If some leader, like him, in my opinion, is saying that there should be no gender-neutral bathrooms, that is the equivalent of saying that there should be no men's bathrooms, that there should be no women's bathrooms. My saying that is problematic, in that people would get upset with it, but at the same time, they are saying that there shouldn't be gender-neutral bathrooms.
It's really where you're comfortable, and it shouldn't be such a harsh debate. It's just being comfortable.