I would definitely be ringing eBay then. Point out that the buyer has a history of leaving negative feedback for non genuine reasons and you feel you are another one of his victims. Tell them to read the negatives he has left for others.

Would love to know who this jerk is, but unfortunately, you can't name and shame on the forums 😞

See if you can leave another follow up reply to the feedback. If you can, write something like <user ID> has a histroy of leaving bad feedback. By leaving their ID in the feedback, others can see who they are. It's worth doing for any bad feedback you get. Then others can see at a glance who it is and take the appropriate action.