Certainly, I think change is scary. Changing the system will have some cost in terms of people adapting to it.
You do worry about small or fringe parties with agendas that would be racist, or so on, getting more visibility than they would normally have. That's the issue with thresholds, so you always worry about that and the worry that you have when you are moving in that direction.