Yes, there is an impact. That may be why there was pushback. One of the elements underlying judicial independence is security of tenure.
Imposing a reduction in pay is perhaps an option, but it may be easier not to change the provision. The fact that a jurisdiction in Canada—Ontario—has done it shows that it is possible.