It would be like if, every time someone tried to infer someone’s mental states from their behaviour, a chorus rose up to object “that’s behaviourism!” It’s not a serious response, and the people who make this parallel argument are perilously close to it.