It's perfectly fine. Everyone has, well not everyone, but enough people that I've gotten over being bothered by it quite some time ago. I think sometimes it is comforting, and sometimes it's confusing, and sometimes it is unpleasant - it depends upon the particular case or circumstance.
And ah - that makes perfect sense. Well, you are always welcome to use the old fashioned variety with knockers.