I wonder if there is a sweet spot somewhere in between. If you just want to talk to your audience about the exact topic, you can use comments/chat.

Ideally Notes feels like not one giant public place with everyone, but a circle with the parts of the Substack network that you participate in where you can have interesting conversations in (and around!) your interests.