I don't have any sons so wont be in this position. I would think it would be quite had for paternal grandparents to have a relationship with the grandchild if the baby's mother doesn't even know them or had little to do with them before the baby was born. Also if baby's mother resents the baby's father from not wanting anything to do with the baby, that resentment would rub off on any dealings with his parents?.