mukel
- Karma
- 0
- Created
- ()
- Submissions
- 0
-
Hi HN, Some would call AI on the JVM quixotic. And so, Quixotic AI was born. jinfer is an inference engine for the JVM: chat, vision, audio, embeddings, reranking, and TTS. No Python runtime, no ONNX, no Docker…
- Fast Llama inference in pure, modern Java (youtube.com)
- Practical Llama 3 inference in Java (github.com)
- Llama2.java: Karpathy's llama2.c ported to Java (github.com)
- A meta-circular Java bytecode interpreter for GraalVM (graalvm.org)