We don't see more of these machines because most tasks are better served by a higher number of smaller machines. The only benefit of boxes like this is having all of that RAM in one box. Very few use cases need that.
Serving remote desktops to several hundred developers. Maybe a video content server for a netflix or youtube type business. Hosting a large search index? Some kind of scientific computing?
Numeric simulation (HPC). Some, not all, simulations need lots of memory. In 2018 larger servers running such had 1TiB, so I'm not the least surprised that six years later it's 16.
Now you just need to figure out how to simulate transistors in an instance of the game, so that you can port DOOM to run on a 2,000,000 transistor DOOMputer.
It sounds less interesting when you realize the system has four processors, so you're getting "only" four terabytes for cpu, which isn't that much more than what you can currently do on
Some applications get latency spikes when dealing with numa systems.
18 comments
[ 3.3 ms ] story [ 54.4 ms ] threadGood for a database, maybe.
What else?
Or do these already exist
Lenovo's slides indicate that they foresee this server be used for in-memory data bases.
Weren't there also distributed fs where the meta-data server couldn't be scaled out?
I tested out running Llama on a 512GB machine, it's rather slow and inefficient. Maybe 1-token/sec.
Would love to know what the framerate would be
Hope I get crazy rich one day so I can spend money doing stupid stuff like this.
Some applications get latency spikes when dealing with numa systems.