No, on the contrary. We can't do that; it would be too easy.
Ministerial responsibility is a fundamental principle. You mentioned Canada Post, for example. In that case, it was precisely ministerial responsibility that prompted me to act, thinking that I couldn't hide behind Canada Post when I'm the one responsible for it. The same is true for the agencies.