Btw, using llama.cpp you can achieve 55 - 45 token/second for processing/generation. if you use a qwen3.8-27B (IQ4_XS) verison, with decent quality in reasoning for coding/tool usage (with a 16GB nvidia). I think now…
Its not so secretive, you can see the parameters they are using (arguments, and inference engine). I understand your point, but the only thing unusual/uncommon about it is the jargon used for LLM/AI systems.
Btw, using llama.cpp you can achieve 55 - 45 token/second for processing/generation. if you use a qwen3.8-27B (IQ4_XS) verison, with decent quality in reasoning for coding/tool usage (with a 16GB nvidia). I think now…
Its not so secretive, you can see the parameters they are using (arguments, and inference engine). I understand your point, but the only thing unusual/uncommon about it is the jargon used for LLM/AI systems.