Yes.
You don't want to have one government that has a particular view of refugee claimants appointing decision-makers who share that particular view, and then have a change in government that brings a whole different view on refugee issues and results in very different adjudicators being appointed. That creates unfairness, because outcomes in refugee applications should turn on the facts and on the law, not on who happens to be appointed as an adjudicator. You can look at models in which there is more deference accorded to experts and less of a role for political actors in appointment processes.