If the House isn't sitting, then it wouldn't bother me that there are not as many buses available, because I'm not rushing somewhere, as I would be when the House is sitting. I've never found that to be a problem with the buses.
For the cafeteria, it's the same thing. I've never found it to be a problem.