The whole thing is a world model- accurately predicting text that describes things happening in a world, can only be done by modeling the world.