I did not read the original phrase as an epithet, but I do think it should have been better worded, perhaps as "privileged white men" which seemed to have been the intention.