I don't know if there is a connection, I would imagine that's a question for a professional to answer if one was required, (at 65, I think it's a bit late in the day').
However, in response to the header of your question then I can answer a bit about that. I atteneded a talk a few months back regarding neglect and one of the speakers was from the psychs and he showed brain scans which demonstrated the physical difference between the brain of a normally developing child and that of a child who had suffered neglect (I believe it was the first five years or so), it clearly showed that certain areas were smaller/bigger etc... I think this is because the brain does not develop the pathways it does when we are interacted with by our parents because those parts of the brain are not stimulated when children are neglected. The extremely unfortunate side of this is they grown in to children who are not only hard to engage but also not very engaging themselves because they lack the appropraite responses, because they're not particularly engaging children, they can be overlooked. Fortunately with lots of care and love, these tide can be turned. But yes, there is a physical difference.