5 comments

[ 3.4 ms ] story [ 13.9 ms ] thread
512 threads and 1GB of on chip cache. Love it!
dear lord that's a monster chip. 128 PCI-e v6 lanes. Looks like it's an TSMC N2 process and each CCD is 155mm2. That's a pretty large die, i wonder what kind of yields TSMC is getting on these.
Wonder what the price will be like on the 64-core high-frequency version... if it's comparable to existing Epyc pricing, this might be the obvious answer for a CFD rig in 2027. Finally something with memory bandwidth way greater than a Mac Studio…
The other side of llm's is the need for rich feedback, often by simulations of various things. And memory latency is a big bottleneck there.

So this chip nicely complements the llm's.

I was sad turin-x never shipped... I wonder if it got displaced by the Microsoft-only HBM integrated part.

I've been pretty happy with 9684X but was looking forward to upgraded cores. 16 channel memory though will be a difficult fit with dual socket systems... would be nice to see it paired up with HBM instead.