This essay is fascinating and insightful. And so well written and explained! Definitely worth the 9 minute read! I will talk about "AI crossing the correspondence horizon" instead of "hallucinating" from now on, as long as brevity is not a must π.
I've read another article recently, written by somebody in the AI industry, that acknowledged the limitation of LLMs to truly innovate in the way humans, like Einstein, do. (Arghhhh! I wish I could find it and share it - I have not been able to π). I remember the conclusion was related to the benchmarks used to evaluate model performance. As if by changing the benchmarks we could drive LLMs toward innovation, or so I understood. I was not convinced by this argument, and your article helped me understand why. Thank you!!