The texts are not nonsense. Saying coherent but novel things about the world, and correctly interpreting almost any text input in context requires a simplified world model, just like a human has. The fascinating and shocking thing about this is that a simple problem like text prediction- solved deeply (pun intended) leads to general intelligence.