Thank you, appreciate it!
I just added experimental support for Xe-LPG and Xe-LPG+ in main so you should be able to try it without a patch now. As I said, I don't have the hardware to test it myself, so let me know how it goes!
Please open a PR! I was too conservative with the supported devices. If your GPU supports XMX we could also explore using it to improve the prefill kernel, but I don't have the hardware to test it myself.
He recently said that he finds Rust less ergonomic and that this also affects code written by LLMs, which he thinks excel at writing C partly because of the enormous, high-quality codebase they were trained on. He sees…
Yeah I see the value but I built Xenolith to target smaller models. I heard antirez saying that he designed DwarfStar also to be forked and tuned to everyone's specific needs. Do you have a specific machine/spec in mind?
Nothing comparable but inspired from DwarfStar I wrote a little inference engine for Intel Xe-LP (no XMX) 32GB laptops. The only model supported right now is a quantized Gemma-4, but I don't exclude in the future to…
Really cute game, nice work!
Thank you, appreciate it!
I just added experimental support for Xe-LPG and Xe-LPG+ in main so you should be able to try it without a patch now. As I said, I don't have the hardware to test it myself, so let me know how it goes!
Please open a PR! I was too conservative with the supported devices. If your GPU supports XMX we could also explore using it to improve the prefill kernel, but I don't have the hardware to test it myself.
He recently said that he finds Rust less ergonomic and that this also affects code written by LLMs, which he thinks excel at writing C partly because of the enormous, high-quality codebase they were trained on. He sees…
Yeah I see the value but I built Xenolith to target smaller models. I heard antirez saying that he designed DwarfStar also to be forked and tuned to everyone's specific needs. Do you have a specific machine/spec in mind?
Nothing comparable but inspired from DwarfStar I wrote a little inference engine for Intel Xe-LP (no XMX) 32GB laptops. The only model supported right now is a quantized Gemma-4, but I don't exclude in the future to…
Really cute game, nice work!