My sense, from the comment we just had, is that there didn't seem to be a problem if all parties that have a seat on the committee were in agreement. I think that on the next occasion I would also endeavour to do not only that, but also, if possible, send a quick email to every member of the committee so that one of the few people, like you, who didn't come to the room would know that we were going to proceed that way.
I don't think this would happen very often, but that's how I would proceed.