It's interesting how deeply uncomfortable it makes people feel when you don't want more. More house, more career, more stuff.

This is because your subtraction is an implicit critique of their constant addition. There's a sort of collective social contract that ‘more’ is the default direction of travel and opting out of that makes people uneasy in the same way that seeing someone dining solo makes an extrovert uneasy.

Your contentment with less disrupts the shared bullshit narrative everyone is telling themselves about why they're constantly chasing more and sacrificing the best bits of their lives because of it.