Darwin actually made room for the evolution of musicality to be sexed, and he treats music as a precursor to language (which for him is essential to thought).

“As the males of several quadrumanous animals have their vocal organs much more developed than in the females, and as a gibbon, one of the anthropomorphous apes, pours forth a whole octave of musical notes and may be said to sing, it appears probable that the progenitors of man, either the males or females or both sexes, before acquiring the power of expressing their mutual love in articulate language, endeavoured to charm each other with musical notes and rhythm.”

Quite the romantic