Hi MacsHeadroom, first author here. Thanks for the great questions about compute/memory trade-offs. The quick take: To give you an example of processing speed, with a 7B model on an NVIDIA V100, EM-LLM processes (or…
I found this quite handy actually, good stuff!
Hi MacsHeadroom, first author here. Thanks for the great questions about compute/memory trade-offs. The quick take: To give you an example of processing speed, with a 7B model on an NVIDIA V100, EM-LLM processes (or…
I found this quite handy actually, good stuff!