I am amazed at how much the ML world has changed from the time chatGPT launched. How we think about models, deployment, and maintainance has all changed.

But it has honestly been hard to keep up.

In this blog post, I'll trace the fascinating development of LLMs, highlighting key architectural and model innovations, scaling breakthroughs, and performance advances that have shaped today's most powerful AI systems.