I have to admit that it doesn't happen often enough to particularly bother me. Tend to just answer the door and politely tell them that I'm not interested. No offence seems to be caused, and I can't say it's ever a blight on my day.
I grew up near a Mormon temple, though, and being visited by their missionaries was like having CID knock on the door.