The judgment around women who travel and work usually isn't about the kids.
It's about the discomfort other people feel watching a woman act on the assumption that her life is hers. Some of that discomfort comes from people who can't act on the same assumption themselves, and the easiest thing to do with envy is dress it up as concern.
"But what about the children" feels a lot like that to me.