You said it would take about a year.
If the decision of the RAD is not what you want, it's still appealable to the Federal Court. You're not eliminating the Federal Court from this equation by adding a RAD. If you eliminate the Federal Court and let the refugee appeal division have the last word, that's another thing, but the Federal Court is always there at any level.
I would have more confidence in Federal Court judges than in members appointed to a RAD. Simply appoint more Federal Court judges who will deal strictly with immigration matters. And reform the refugee system.