Quixotic AI is a serious attempt to bring an end-to-end AI stack to the JVM.
Performance is already competitive with llama.cpp (on CPUs), the APIs are crafted to be simple and easy to use. Every component in the stack can be used standalone.
It supports the latest and greatest open models Gemma 4, Qwen 3.5+, LFM 2.5 and many more ... the whole stack fits in a 2.6 MB fat .jar, with no additional dependencies.
And finally, as the project author I've had an awesome time working on it and really enjoyed every bit of the development, this is opium for the intellect.
1 comment
[ 1.8 ms ] story [ 10.0 ms ] thread