Spanda: Sub-microsecond LLM epistemic uncertainty in Rust

1 points by liquidngas ↗ HN

6 comments

[ 0.16 ms ] story [ 32.9 ms ] thread
(comment deleted)
Creator here! Happy to answer any questions about the Rust implementation, the zero-GPU exact-match math, or the benchmark results.