One of the aspects of The Challenge that I have been working on addressing this week is the efficiency of a chron. I wasn’t happy that it took over 500 chrons for my first week of the challenge. As a result, I’ve been working on implementing prompt caching in our LLM layer and am already seeing some great cost reductions that I’ll be able to pass on directly to our users.
Apr 17
at
6:36 PM
Log in or sign up
Join the most interesting and insightful discussions.