Understanding LLM Compute Requirements (intuitiveai.substack.com) 4 points by pgspaintbrush 3y ago ↗ HN
[–] brucethemoose2 3y ago ↗ Inference is not that flop intense for modern IGPs... the bigger issue is the sheer memory requirements.Training requires a ridiculous amount of both, but again the raw compute requirements would be much lower with huge memory pools.
2 comments
[ 3.6 ms ] story [ 13.9 ms ] threadTraining requires a ridiculous amount of both, but again the raw compute requirements would be much lower with huge memory pools.