Ilya Sutskever’s shocking statement at NeurIPS 2024: the end of pre-training and data exhaustion. The AI industry must adapt to new models beyond large-scale pre-training.