logo

Language models imply world models

Posted by gbacon |2 hours ago |1 comments

chrisjj an hour ago

> as a “Large Language Model”, Claude necessarily includes a model of the world in general

> as a theory it has been widely entertained since the very earliest days of digital computers. Yehoshua Bar-Hillel, the first person to seriously investigate machine translation, came to this conclusion in the 1950s.

> Bar-Hillel says, and I agree, that an accurate model of language requires an accurate model of the world.

This is a schoolboy error. Requires != includes.