yup, seems sensible because we have been getting gouged to death with high prices for a minute. Being that 4090's are going for $2000. I suspect we are going to see 5090's easily settle at $3000. The demand from the AI space is intense.
The current market being a monopoly where your next best choice are HPC cards, again by nvidia?
$2000 gives ludicrous profit margins and the mid and especially low end 5000 series will suffer. Hopefully AMD eats them up in the non-compute market.
Ah, looks like the 5070 = 4070 is not anywhere close to fair. It requires generating multiple frames per game engine frame and running the older DLSS on the 4070.
The real world differences with the same settings looks to be MUCH slower. Seems like 5xxx = 4xxx * 1.3 or so. 3rd party benchmarks that are MUCH fairer should be out later this month.
Despite the flak Nvidia gets for VRAM sizes, 5090 seems to be a decent offer. Can’t say the same about the rest of the line.
FWIW, it appears the best homelab set up would still be 2-4x 3090 if you want VRAM for LLMs, but a single 5090 would likely be the best in class for prosumers on any less VRAM heavy tasks such as image / video generation or deep RL research
24 comments
[ 2.1 ms ] story [ 35.0 ms ] threadI don't understand AI TOPS. Per NVidia:
* 5090: 3352
* 4090: 1321
* 3090 Ti: 320
* 3090: 285
* 3060 Ti: 130
* 2080 Ti: 114
source: https://www.nvidia.com/en-us/geforce/graphics-cards/50-serie...
What's increased tenfold since Ampere? Can someone explain this to me and how it impacts real-world performance?
The real world differences with the same settings looks to be MUCH slower. Seems like 5xxx = 4xxx * 1.3 or so. 3rd party benchmarks that are MUCH fairer should be out later this month.
FWIW, it appears the best homelab set up would still be 2-4x 3090 if you want VRAM for LLMs, but a single 5090 would likely be the best in class for prosumers on any less VRAM heavy tasks such as image / video generation or deep RL research
> … Jan. 30 at $1,999 and $999, respectively.
At least we are getting more VRAM and wider memory width at 32G and 512-bits, respectively [1]
I’ll still wait for the reviews though.
[1] https://www.nvidia.com/en-us/geforce/graphics-cards/compare/
was expecting 32/24/24/16 not 32/16/16/12 like wtf