This is outdated information as the ranking has been heavily influenced by (wrong) DROP benchmark results. The current leaderboard thus has that particular benchmark not listed anymore, see the Huggingface blog for more…
The RTX 4090 has 330.3 TOPS with INT8 precision, so for inference workloads it is still a magnitude faster
This is outdated information as the ranking has been heavily influenced by (wrong) DROP benchmark results. The current leaderboard thus has that particular benchmark not listed anymore, see the Huggingface blog for more…
The RTX 4090 has 330.3 TOPS with INT8 precision, so for inference workloads it is still a magnitude faster