To the extent that machine learning is really “learning”, which I think I don’t want to dispute at all—they really do this, and it’s really remarkable—it’s not what I think phenomenologists call “embodied” learning, born out of a struggle with the material world and sensorimotor perception. All the LLM has is language, with nothing to check it against except more language. It doesn’t have a special status for “that which is the case” (Tarski?), though it may have preferred sentences and dispreferred sentences. It doesn’t have a way of predicting a sentence (“All swans are green”) is dispreferred.

Oct 22
at
2:51 AM