Llama2.mojo - outperforms Karpathy’s llama2.c by 30% in multi-threaded inference (github.com) 2 points by swyx 2y ago ↗ HN
[–] notnap 2y ago ↗ Isn’t llama2.c was just a fun project for Karpathy?When I compared llama2.c to llama.cpp it was way way slower.All the mojo <insert number>x speed up claims I’m hearing about always use the baseline of some toy examples that nobody actually uses IRL.Am I missing anything?
1 comment
[ 3.2 ms ] story [ 16.4 ms ] threadWhen I compared llama2.c to llama.cpp it was way way slower.
All the mojo <insert number>x speed up claims I’m hearing about always use the baseline of some toy examples that nobody actually uses IRL.
Am I missing anything?