Was Einstein Just Autocomplete? (audriusberzanskis.substack.com)

LLMs are missing the extracellular matrix (ECM), the twenty-percent by volume scaffolding we (well, mice) have, which contributes to memory:

https://news.ycombinator.com/item?id=48336312

One could train an LLM on pre-Einstein, or pre-Newton, material, and see if it can "invent" the laws of gravity or relativity. If enough care is done in avoiding contaminating the training corpus, that should settle the question.