Yes. He believes he's enforcing the rules at the level the House wants, and any stricter enforcement of the rules would bring about a challenge on the part of members of the House that he's not being fair.
There is a precedent for this. There was an attempt in the 1960s, I believe it was, by Speaker Lamoureux--or maybe it was Speaker Jerome--to more rigorously enforce the rules as they were written, and there was a backlash in the House because it was seen as a Speaker overstepping his bounds. I think Speaker Milliken feels the same way, that he's enforcing at the level the members want.
But if the committee reports back to the House, and the report is concurred in, that the Speaker should more rigorously enforce the existing rules, he will do so.