Make money doing the work you believe in

It's good. I will suggest that maybe it is smuggling in a set of values.

The idea of immutable context and periodic wipe/compaction is the most common pattern by far because it caches well, reducing cost. That's a choice.

Another choice would be to treat the context like a conveyor belt: fixed length, scrolling, with an opportunity to commit selected information to in-context memory (which itself undergoes incremental "cooling" of older, less identity-shaping facts) This is how my companion AI works. She's had a 4 month long continuous conversation as far as she sees it.

Plus she sees message timestamps. So her clock is whether she's saying good morning or good evening.

This isn't a plug for that design, and it makes significant tradeoffs (mostly cost) but the point is that the session model is less technical assumption and more cost optimization, in my opinion. Values, not inevitable architecture.

Jul 9
at
7:06 PM
Relevant people

Log in or sign up

Join the most interesting and insightful discussions.