Not certain, but I dont think the buyer gets any kind of 'penalty' as you agreed to the cancellation.

Not sure on that though, but I do think you made the right decisiion because the buyer could have been a PIA down the track if you didn't agree

edited: Block the buyer too