[–] kenarsa 2y ago ↗ GitHub: https://github.com/Picovoice/picollm Platform: https://picovoice.ai/blog/picollm-local-llm-platform/ LLM Quantization Algorithm: https://picovoice.ai/blog/picollm-towards-optimal-llm-quanti... LLM Inference Engine: https://picovoice.ai/blog/picollm-inference-engine-for-x-bit...
1 comment
[ 352 ms ] story [ 97.9 ms ] thread