It's not that you refuse to talk politics with them.
There was a time when we could talk about these things over a beer and it wouldn't end in a knock-down drag out, or not speaking, but the rhetoric now is to the point where there is no point. Disagreement is hate to them, and any a difference in opinion is misinformation.
On twitter, I get blocked inevitibly in talking about the Covid narrative. I don't block them, I don't refuse to talk to them. But to them I am "making up facts" I am "living outside reality." In their reality masks work, one more booster will solve the issue, and if we only all went against human nature...we could get through this.
Mu guess is that you don't want to talk politics because there is no "talking about politics." Because talking about infers an exchange of ideas. What they want to do is enforce "correct thinking."
I have a friend who claims to be libertarian, and I disagree with most things he says. But I am going to listen to him. He is pretty far left, leaks out Trump related stuff. And then occasionally I will say heretical things like "No, I am not going to use the "correct" pronouns...and furthermore they can use whatever pronouns they want for me because I know they are thinking them.
What do I know though?