I would also add that if I saw a file full of a million X's, I would not track each X as a distinct item in my mind, I would simplify the visual input down to "this is a file containing a lot of Xs" and work with that…
I think that's an oversimplification. LLMs have a limited context window of tokens. But that isn't necessarily a limitation: it's been proven that a LLM can simulate any algorithm even with a limited context window…
I would also add that if I saw a file full of a million X's, I would not track each X as a distinct item in my mind, I would simplify the visual input down to "this is a file containing a lot of Xs" and work with that…
I think that's an oversimplification. LLMs have a limited context window of tokens. But that isn't necessarily a limitation: it's been proven that a LLM can simulate any algorithm even with a limited context window…