Yes—just like that right there.
I mean, that's not abusive or offensive to the interpreters when you just mention a quick little whisper. I don't really care that you do that. You didn't say it in a rude and angry way. It's kind of fun and good-natured. It's not, “Oh, no, now he's glaring at me”—