Depends on what is meant by swinging. If it's of the metaphorical type, then it may not look like flailing at all, but standing up to the intimidation. Could be simply giving someone the stink eye instead of capitulating. Do you know how much it bugs the s out of them to hear the word "no?"