[–] generall 3y ago ↗ With a few optimization tricks, TL;DR: - ONNX inference in Rust - Embeddings cache & lookup - Parallel & Batch requests - hybrid search with full-text filtering + vector re-scoring
1 comment
[ 4.3 ms ] story [ 22.3 ms ] thread