If they purchased both of them from you then I would indeed cancel one of them, you cannot open a mutual cancellation once an unpaid item dispute has been opened but you can close it for the reason that you and the buyer have agreed to cancel the transaction.

If you mean they purchased from another seller too I would just let the dispute go the 4 days and issue them a strike, may teach them not to be so irresponsible again.