A 1 hour overview of all the various pieces it takes to build a leading language model. Decisions from pretraining to evaluation and post-training, I touch on all the things.