I have heard the argument a lot that it may be very hard for Federal Court judges from Quebec. It must be said that a number of Quebec's former great legal minds currently sit on the Federal Court, and I will never have anything but good to say about that.
If I am not mistaken, judges have been appointed from the Federal Court, but that was to fill one of the other six positions on the Supreme Court of Canada.