I do not think that refunding the buyer straight away has any effect on the defect at all.

A couple of months ago I received a defect for an item that I refunded instantly.  That defect stood regardless of the fact that I had given an instant refund.

It is still registered in my seller dashboard.