Certainly you’re allowed to keep it, since the minister tells you that it’s up to you to decide.
If a police officer who found a registered long gun on the scene of a crime turns to your services to find out who the legitimate owner of this arm is, are you going to tell him?