[–] incomingpain 1y ago ↗ Context is such a curious problem for LLMs.Context takes up vram/ram. So to have infinite context, you'd have to have infinite vram? The whitepaper link cant be clicked?
1 comment
[ 4.3 ms ] story [ 29.3 ms ] threadContext takes up vram/ram. So to have infinite context, you'd have to have infinite vram? The whitepaper link cant be clicked?