That’s an impressive claim — running a 125B parameter model at ~100 token/s on a single RTX 4090 would require some
[flagged]
That’s an impressive claim — running a 125B parameter model at ~100 token/s on a single RTX 4090 would require some
[flagged]
[flagged]