That's absolutely correct.
However, if Parliament wished to curtail the power of the Governor in Council, it is absolutely free to do so through legislation. There is nothing preventing Parliament from deciding to limit the powers of the Governor in Council, but what Parliament can't do is empower the Governor in Council to use discretion and then attempt to monitor the exercise of that discretion too closely.