2 comments

[ 0.25 ms ] story [ 23.3 ms ] thread
The next wave of AI products may be won on latency and cost rather than benchmarks
I keep seeing single-person hobby projects in C++ bodying e. g. tiktoken which is supposed to be peak performance rust (another recent project I saw was vibta being much faster than songrec).

It seems like at least at a certain project complexity the performance problems from rust are unavoidable. But I guess when people are used to js or python performance it seems fast.