Model can accept 1M tokens doesn't mean it can reason across those 1M tokens (twitter.com) 2 points by annjose 2mo ago ↗ HN
[–] turtleyacht 2mo ago ↗ Looks like there is a memory hierarchy [1] even in LLMs.[1] https://en.wikipedia.org/wiki/Memory_hierarchy
1 comment
[ 1004 ms ] story [ 4895 ms ] thread[1] https://en.wikipedia.org/wiki/Memory_hierarchy