Had you affixed the label or was it the post office putting the label on ?

 

Those stickers the PO uses (which only has the cost) have very strong adhesive and I can't imagine them ever coming off.

image host