Right now this is a general setting in relationship access and it is not possible to show the custom field just for the child's parent and not to every parent in our entire database. We should have access to providing a child's parent with sensitive information that does not get broadcasted to the rest of the parent community.