6.4x faster than llama.cpp, 3.9x faster than MLX (basecompute.co)

4 points by lukasonedge 2mo ago ↗ HN

4 comments

[ 3.7 ms ] story [ 20.3 ms ] thread

[deleted] 2mo ago ↗

(comment deleted)

[dead] lukasonedge 2mo ago ↗

[dead]

d3Xt3r 2mo ago ↗

Headline is missing a critical detail: "on Apple Silicon".

para_parolu 2mo ago ↗

I wonder how it’s compared to https://github.com/antirez/ds4