3 comments

[ 3.0 ms ] story [ 16.3 ms ] thread
Other sites missed this. To quote STH:

> Something that AMD is not focusing on, but that we have seen folks talk about when we have seen MI300 platforms live over the last few weeks, is CXL. AMD supports CXL Type-3 devices with its parts. There is a path to getting more memory, and that path uses CXL memory expansion modules. That is huge.

So the MI300 it not necessarily limited to (8x)192GB. Modules like this can be added in for a huge, cache coherent memory pool.

https://semiconductor.samsung.com/us/newsroom/tech-blog/expa...

Its slow... But still faster and much easier than external networking.

We've been hearing about CXL for years but now that Sapphire Rapids and Genoa are out... nothing. Is CXL even real?
The demand is there. If CXL expansion cards could directly attach to A100/H100 GPUs, you can bet server makers would be doing it.