World Models vs Language Models.
Language Models (LLMs) have given us an extraordinary command of concepts, vocabulary, and reasoning.
But our world is not made of words. Our physical world, virtual or real, runs on a different substrate.
Where language models learn the statistical structure of text, world models learn the statistical structure of space and time.
I resonate deeply with this and see the flaws with our current Gen AI technology, particularly LLMs. Excited to see how world models evolve.