Agree. I commented in a previous version of this post that if we zoom out further (1950-2022) I think there are other natural confounders - namely cyclical drops in birth rate, correlations to (changes in, e.g. increase in) the average age of first time mothers, as well as drops in immigration which I think also contribute.