Yes. The Federal Court would have the expertise in law, I agree with you, but the difference between the Federal Court jurisdiction and the RAD jurisdiction is that the Federal Court jurisdiction can only review and quash an erroneous decision or uphold a correct decision. The RAD can actually enter the correct decision. The Federal Court can't enter the correct decision because that's not part of its jurisdiction.
Evidence of meeting #29 for Citizenship and Immigration in the 39th Parliament, 1st session. (The original version is on Parliament’s site, as are the minutes.) The winning word was federal.
A recording is available from Parliament.