You can paper launch as much as you want but Blackwell isn't shipping until Q4. Also Blackwell's lead will be short lived, because mi350x is coming out next year, and it will have a node and architecture advantage. So…
None of those things matter, if all you're looking to do is run your existing workloads on mi300x in the cloud. You get more bang per buck by going AMD.
I don't understand why they should use TensorRT. vLLM is much more popular and it was actually written for Nvidia. It also supports AMD hardware, so it's the appropriate tool to compare.
People used the same argument when saying AMD would never beat Intel in CPUs. Intel has a lot of software engineers. Also these days AMD has a good number of software folks, thanks to the Xilinx acquisition and the…
The author also says that AMD doesn't have Tensor cores. No shit, Tensor core is an Nvidia trademark. AMD has matrix multiplication units in their CDNA GPUs.
As a hobbyist you should look into spot instances in cloud. Way cheaper and faster than having to invest in your own hardware.
Yes you can. And AMD's Linux driver is much better.
Epyc 2 (Rome) will have up to 64 cores.
But the GC has to do it in a thread safe way which involves locking/synchronization. Otherwise you get nasty race conditions.
It's only a space heater when it's being used. These CPUs consume very little power when idle. So if you have a task that can leverage 32 cores.. that task should in theory complete that much faster than on your 65W…
It's not happening because it's hard to do. Extracting instruction level parallelism is difficult(which is how CPUs gain IPC) and then also the cores have to be wider with exponential complexity. ie. At the point you…
It's important to note their ARM CPUs aren't anything to write home about. Mostly a slightly modified version of ARM's own reference designs.
The reason why Intel has iGPUs in their CPUs in the first place is a result of Intel licensing Nvidia tech. So you're telling me after Intel has paid Nvidia billions to use their tech, now it should be illegal for AMD…
You can paper launch as much as you want but Blackwell isn't shipping until Q4. Also Blackwell's lead will be short lived, because mi350x is coming out next year, and it will have a node and architecture advantage. So…
None of those things matter, if all you're looking to do is run your existing workloads on mi300x in the cloud. You get more bang per buck by going AMD.
I don't understand why they should use TensorRT. vLLM is much more popular and it was actually written for Nvidia. It also supports AMD hardware, so it's the appropriate tool to compare.
People used the same argument when saying AMD would never beat Intel in CPUs. Intel has a lot of software engineers. Also these days AMD has a good number of software folks, thanks to the Xilinx acquisition and the…
The author also says that AMD doesn't have Tensor cores. No shit, Tensor core is an Nvidia trademark. AMD has matrix multiplication units in their CDNA GPUs.
As a hobbyist you should look into spot instances in cloud. Way cheaper and faster than having to invest in your own hardware.
Yes you can. And AMD's Linux driver is much better.
Epyc 2 (Rome) will have up to 64 cores.
But the GC has to do it in a thread safe way which involves locking/synchronization. Otherwise you get nasty race conditions.
It's only a space heater when it's being used. These CPUs consume very little power when idle. So if you have a task that can leverage 32 cores.. that task should in theory complete that much faster than on your 65W…
It's not happening because it's hard to do. Extracting instruction level parallelism is difficult(which is how CPUs gain IPC) and then also the cores have to be wider with exponential complexity. ie. At the point you…
It's important to note their ARM CPUs aren't anything to write home about. Mostly a slightly modified version of ARM's own reference designs.
The reason why Intel has iGPUs in their CPUs in the first place is a result of Intel licensing Nvidia tech. So you're telling me after Intel has paid Nvidia billions to use their tech, now it should be illegal for AMD…