3 comments of 4

[ 0.22 ms ] story [ 11.3 ms ] thread
Anyone know if a MoE model that can run on a gpu with 16GB VRAM (like 3.6-35B-A3B) is in the pipeline as well, or only the dense 27B one?