After exposure to social-justice spaces, I became less comfortable asking non-white people this question unless they had an obvious accent and gave off pretty chill vibes. But I continued to ask white people (and have been asked that myself). I live in Vancouver, and almost everyone who lives here was born somewhere else, regardless of skin colour. I mean, I get being annoyed if you answer “I was born in Vancouver” or “I moved here from Toronto” and someone keeps pestering you for your ethnic heritage, but here at least, “Where are you from?” is a normal question because almost no one is locally born.