With regards to RAM price I never understood the following: A 16GB RAM stick has 16*8=128 billion bits, with 1 transistor per bit, thats still 128B, yet its supposed to cost like $60 before the price hikes? In contrast, a 5090 GPU was $2000 (true it has RAM, but you're paying for the GPU ASIC really, I guess the rest of the GPU was less than $500), it had 93B transistors.
GPU transistors are smaller due to the more advanced process node (cost per transistor metrics aren't really clear, if they improve on advanced node or not, but I'd say they get cheaper as they get smaller, as technology costs are amortized).
I'm sure both RAM and logic use a process that is quite similar in both inputs and manufacturing steps. So while RAM is a commodity product, this insane price difference didn't make any sense.
So I guess when those fundamental inputs become a constraint, it would make sense for $/transistor move closer for both, which is a massive hike for RAM.
I have always wondered why there was never a big market[1] for "cheap PCI/PCI-X/PCI-e card you can stick a boatload of your old/surplus/n-generation old simms/dimms on and use as swap/slow memory/ram disk/etc". It's rare you can populate a motherboard with a full address space full of 'new' memory, and you can teach kernels to prefer some memory to others because of speed[2], so it seems like a no-brainer.
I seem to remember the market for doing similar with flash got neutered over patent issues, but I can't recall the details. And flash cache did end up being a market, at least for bigger players. Maybe something similar happened here, or maybe it just hit a niche I cared about at the time?
[1] I know there were a handful of products in this space, but my impression is they never really took off. I could be wrong.
[2] Definitely can in NetBSD; I've done it for archs like VMEbus where it's common to have a small, fast on board memory and much slower, often larger memory out on the bus. I assume this sort of thing is enabled in Linux by the work to support NUMA, but I've never looked into it.
You could give it a similar structure to CPU cache or a giant swap file. Have a giant blob of memory on the PCI RAM, that feeds the on board smaller motherboard RAM as needed. It might just work.
At the beginning of William Gibson’s Neuromancer, the protagonist is trying to sell 3 MB of RAM in underground markets. This is often cited as one of the ways the book has not aged well. But, looking at the direction of the memory market now… maybe we just haven’t gotten there yet.
I've always wanted to set up automation that updates the text for the book every so often to preserve original intent, by changing the language around quantities to <whatever would make a contemporary reader be impressed>
Replace "megabyte" with "exabyte" or whatever.
As an aside, there's a great essay I think in Metamagical Themas about the fuzzy task of translating literary works, which takes up the question of whether it would be valid and how to translate say Dickens into French, by relocating from London to Paris.
Part of the premise is that this is an impossible task because the referential systems are not truly analogous; the cultures aren't identical so some concepts literally have no direct translation...
...in Neuromancer the mere existence of a bank of pay phones has stood out as one of those things which even my little updater would break hard.
Also related: I've seen a slowly increasing number of complaints in book forums about text from relatively recent novels being silently updated, to change references from e.g. Myspace to Tik Tok or whatever, to try to keep the text feeling current... a perilous slope.
In early computing history, the unit of memory was not established yet, and different hardware architectures had different word sizes, not even necessarily evently divisible by 8. And the memory sizes of these machines used to be expressed using the naitive word size. Like “this machine has 8 kilowords of core”. Therefore, when I encounter an anachronistic memory size in old fiction, I just assume that I just don’t know the word size they are using.
Side note. It is sort of the unwritten rule in TV and Film. Don't highlight technology unless absolutely necessary. it can age it considerably.
A few weeks back I had '30 Rock' on, it was funny seeing everyone with flip phones, it wasn't highlighted but it just makes you realise the age of it all.
It will be interesting to see what happens to the consumer electronics market the next few years. Companies are right now gambling that consumers will pay extra because of RAM shortages. I suspect with the cost of everything else rising as well, a large portion of consumers (remember, HN, not everyone makes tech money) will just not be buying new devices for a bit.
OS makers are going to have to support older hardware longer. Win10 is already pushed out another year because MSFT tried to force new hardware for Win11.
I wonder if it would ever start to make sense to burn an AI model into ROM, replacing a large portion of an inference machine's RAM with ROM. (Probably not, since I'm sure those machines do dual-duty and run training when the inference workload slows down)
It'd be interested to see how one could leverage all the DDR3 ECC that they may have laying about; maybe an overseas shopping site has these boards available? Would DDR3 be as fast or faster than an SSD?
I am have an old Pentium 4 with RDRAM, think I could sell it to them? I think it has like 256MB. Haven't turned it on in awhile. Hope the first 640KB still work.
48 comments
[ 3.6 ms ] story [ 61.0 ms ] threadTIL there are 2x 2.5GbE PCI-E HAT adapters for Pi 5.
How to attach RAM to the new NVLink/UALink fiber buses?
This yields for exciting ideas or workarounds that might result a post-crisis memory boom (hopefully) also for local machines.
1. Lowest, Apple is evaluating new Chinese manufacturer which means change of supply demand if indeed it has reasonable QA. (https://www.ft.com/content/f4ac5c92-03be-4499-b16a-017a7e9ee...)
2. Companies tries to workaround performance - suddenly single channel is 'ok' ? :) (https://www.gigabyte.com/press/news/2403)
https://www.theregister.com/systems/2026/06/29/zuck-saves-me...
https://www.marvell.com/products/cxl.html
GPU transistors are smaller due to the more advanced process node (cost per transistor metrics aren't really clear, if they improve on advanced node or not, but I'd say they get cheaper as they get smaller, as technology costs are amortized).
I'm sure both RAM and logic use a process that is quite similar in both inputs and manufacturing steps. So while RAM is a commodity product, this insane price difference didn't make any sense.
So I guess when those fundamental inputs become a constraint, it would make sense for $/transistor move closer for both, which is a massive hike for RAM.
"Our CXL solution achieves substantial gains for diverse workloads, including up to a 25% reduction in server count for disaggregated ML inference"
How does using worse RAM result in 25% reduction of server count for given workloads?
I seem to remember the market for doing similar with flash got neutered over patent issues, but I can't recall the details. And flash cache did end up being a market, at least for bigger players. Maybe something similar happened here, or maybe it just hit a niche I cared about at the time?
[1] I know there were a handful of products in this space, but my impression is they never really took off. I could be wrong. [2] Definitely can in NetBSD; I've done it for archs like VMEbus where it's common to have a small, fast on board memory and much slower, often larger memory out on the bus. I assume this sort of thing is enabled in Linux by the work to support NUMA, but I've never looked into it.
Replace "megabyte" with "exabyte" or whatever.
As an aside, there's a great essay I think in Metamagical Themas about the fuzzy task of translating literary works, which takes up the question of whether it would be valid and how to translate say Dickens into French, by relocating from London to Paris.
Part of the premise is that this is an impossible task because the referential systems are not truly analogous; the cultures aren't identical so some concepts literally have no direct translation...
...in Neuromancer the mere existence of a bank of pay phones has stood out as one of those things which even my little updater would break hard.
Also related: I've seen a slowly increasing number of complaints in book forums about text from relatively recent novels being silently updated, to change references from e.g. Myspace to Tik Tok or whatever, to try to keep the text feeling current... a perilous slope.
A few weeks back I had '30 Rock' on, it was funny seeing everyone with flip phones, it wasn't highlighted but it just makes you realise the age of it all.
https://www.andysarcade.net/store2/all-other-stuff/vintage-c...