[–] mezark 9mo ago ↗ We look at how comparative advantage from economics applies to LLM inference - some GPUs are relatively better at FLOPs, others at memory bandwidth. What happens if you let each do what it’s best at?
1 comment
[ 2.6 ms ] story [ 16.5 ms ] thread