Why not get your post master to "stamp" the stamps, so they are cancelled, then sticky tape the hell over them?
*we may be human, but we are still animals*