Sure there is, but how do you become an elite pistol shooter without training? Do you just come off the street and say that you think you're going to be an Olympic volleyball player today? It takes years of training. You put years of work and effort into it.
There's the rule of about 10,000 hours to become an expert in anything, and yet we're going to limit the people who are allowed to have an exemption to people who are already champions, who are already winning and who are already Olympians. That means you get rid of the entire sport. How do you prove that you want to become a professional or an Olympian in something before you actually can prove that you are one?