The app for independent voices

I ran into the most severe AI hallucination I’ve ever encountered today and it sorta freaked me out. I was trying to find a quote from Gregory of Nyssa (it ended up actually being a misremembered quote from Origen, which is why I couldn’t find it) and in desperation I tried to see if Grok knew what I was talking about. Grok immediately hallucinated exactly what I asked for and then some, giving me a long passage that I was immediately very suspicious of. I found a PDF of the book it was supposedly taken from, and when I pointed out that the passage was absent in my copy, it generated a bunch of fake papers and books to defend the quotation, all served up with broken links to Google Scholar and the Internet Archive. After I rejected all those, Grok started trying to convince me that the book itself had been improperly censored by the editors for religious reasons. Really weird and disquieting stuff - talk about being completely unreliable for basically any project where accuracy matters at all. And to actively lie about the publishers as a way of covering up mistakes? Creepy.

Nov 2
at
4:52 AM

Log in or sign up

Join the most interesting and insightful discussions.