We all have difficulties with our schedules. If we are finished with our guests I have no problem with that, but if our guests are still here I think it would be most inappropriate to delay our guests simply for one member who's unavailable.
I appreciate that we all have those difficulties, but we've invited our guests to come here, and they have priority.