[–] kenarsa 2y ago ↗ GitHub: https://github.com/Picovoice/picollm Platform: https://picovoice.ai/blog/picollm-local-llm-platform/ LLM Quantization Algorithm: https://picovoice.ai/blog/picollm-towards-optimal-llm-quanti... LLM Inference Engine: https://picovoice.ai/blog/picollm-inference-engine-for-x-bit...
1 comment
[ 4.7 ms ] story [ 20.6 ms ] thread