Isn't there provision in the rules somewhere that if a buyer refuses delivery they aren't entitled to a refund?  Have you got something in the tracking to say that it was refused?  If you have, make sure you take a screenshot of it in case it disappears.  I'm pretty sure this was discussed pretty recently in another thread.