That question is I think a really good one, and it's one I haven't thought about a lot, so I'm not sure I can give you a good answer.
I would say that it's a real issue and that you'd have to look at the situation. I'm sure the people around you can provide good answers as to what kinds of standards and limitations should be applied in that situation. It's not something you can ignore.