The Privy Council Office is the Prime Minister's department. It's part of the executive branch of government. It is the Prime Minister's department, and the Prime Minister is the minister, just like any other department, and the Clerk is the deputy minister, just like any other department.
It's not independent in the sense of the courts, but it is separate from Minister Sajjan. I guess that's the argument he was making. It was somebody from outside.