Missionaries becoming a nuisance

Hey there. After being inactive for a while, my family and I are starting to come back. It's kind of a delicate path right now for various reasons. Anyway, missionaries have been doing the "drop-by" a couple times now. Its often the middle of making dinner, finishing work, or helping kids with school work, etc. In fact its becoming quite burdensome. I'm sure they want to talk about un-baptised members of the family, but they drop by at the most inopportune times. And it's not like those member are ready to sit and meet with missionaries right now.

I've told them that they should call first, or we will call when ready; but no more unannounced visits. I kinda lost my cool this most recent time... it's getting quite annoying. Has anyone else had issues with this? Ward members have been awesome, but this experience is causing me to question if it's better just to stay away. Thanks.