The main problem is lack of father's or disengaged father's.
Thats about half of men. That alone would solve many of the legitimate concerns you bring up.