You also leave false positives for buyers (breach of rules) and have more than one customer saying you are rude.

If you feel the abuse was unwarranted, report the buyer to eBay and show them the 'abusive' messages, remembering that the entire conversation, back and forward, will be visible to eBay.