19 comments

[ 5.4 ms ] story [ 37.7 ms ] thread
What has changed now in the memory landscape/ai workload in the recent months compared to summer or spring?
The clear winners of AI are memory makers.
It’s sad to see the one area of life that has long resisted inflation (computing) now succumb to inflationary forces. Other than emergency situations such as COVID-19, I’m used to seeing prices going down over time for computers and their components. It’s one of the rare bright spots when everything else is escalating in price, and now that’s disappearing.
I know one area of computing that has dramatically risen in price in the past 10-15 years or so is GPUs. Cards that fit into midrange today sell for prices that would've been considered ultra-highend just a few gpu generations ago. Today's highend prices for just a graphics card are higher than I've paid for entire computers in the past. It's ridiculous.
Those price increases seem pretty reasonable given the shitty situation. I bought a Jetson 8GB a few weeks ago for $350 CAD from Amazon, I just checked that same listing and it's now $430.
What surprises me the most is the 1GB option is even viable though I can imagine this will be for IoT users who shove Pi's into things doing embedded stuff where a kernel with a few user space things along with maybe a container are doing all the work.
> What surprises me the most is the 1GB option is even viable...

There are plenty of non-IoT use cases that are viable with 1GB of general-purpose compute. Hell, I rented an obscenely cheap 512MB VPS until recently, and only abandoned it because its ancient kernel version was a security risk.

Most of my RPi tasks are not memory-bound

you would be surprised to find out some of us are doing fine with 512mb pi zero w.
Nothing wrong with this. Some applications really are compute bound and don't need much RAM, such as a homemade surveillance camera system I have, presently running on a couple of Raspi 4s. Suppose I wanted to upgrade to Raspi 5, why spend extra money on RAM that's not needed? These things run headless with the only GUI exposed via web server.
I don't really blame them, but my question is, if ram price goes down, will RPI drop its prices? My experience with other companies is no.
Of course not
The article mentions "the $10 Raspberry Pi Zero". I feel this is rewriting history. The Raspberry Pi Zero was $5 when it was released back in 2015. It was mostly out of stock, but I did manage to get one unit at that price eventually.

Nowadays you can no longer get the Raspberrry Pi Zero for less than 12€ or so. I consider the $5 Raspberry Pi Zero to be among the best values on the market and there hasn't been anything else that came close.

Starting to hate OpenAI. Them and their Trillion Dollar deals with data centers and gpu manufacturers
What do you think, when will the ram prices come back down again? Years, months?
(comment deleted)
$45 USD is equivalent to about 63 CAD. This is crazy considering that I brought 4GB one last year for $70 CAD.
On the bright side, hopefully rising memory prices will give Microsoft and its ilk the kick up the pants they need to reduce memory usage in Windows et al
I guess ram compression is going to be back in fashion for a while.