And the buyer will probably give you negative feedback for cancelling and low DSR ratings which could equate to defects as well.

You need to carefully word your request to cancel to the buyer and hopefully they will be OK with it.