Don't click recalculate in the invoice, that reverts it back to the original.
Just adjust postage cost and send. Preview to check it if you want.
If they have paid you won't have send invoice but can do a part refund in PayPal for the postage difference.