The Wall of LLMs (carrotandstick.games)

I think JEPA / World models are the only real path for LLMs to truly "experience" the world. Until then, LLMs have no direct perception of the world.