This is awesome to see. I know its still in the early simulation stages, but do you have a rough idea what your communication budget (a_fwd) would translate to in practice? It's currently move or talk, but moving is…
Probably not for 2-3 decades unfortunately. The largest FPGAs in the world come out around ~10 million cells (the programmable component of an FPGA). GPT-2 is 1600 million parameters, Qwen 3.5's smallest model is 800…
This is awesome to see. I know its still in the early simulation stages, but do you have a rough idea what your communication budget (a_fwd) would translate to in practice? It's currently move or talk, but moving is…
Probably not for 2-3 decades unfortunately. The largest FPGAs in the world come out around ~10 million cells (the programmable component of an FPGA). GPT-2 is 1600 million parameters, Qwen 3.5's smallest model is 800…