Transformers Create Shapes of the Universe (danielmiessler.com)

Haven't seen this train of thought discussed. Takes some interesting comments from Karpathy and others to argue that transformers can distill down things well beyond just text and images