No worries, yes it does look like quite a mean chip. Though, please note that NV give their FLOPS as 'sparse flops' which is ~double the FLOPS the chips get for dense matmuls. This can trip you up when comparing numbers!
> Nvidia has a "superchip" coming out this they are advertising as 10 times faster than the previous generation (I assume H100 or something). Just a nitpick on this point, can you elaborate? Are you talking about Grace?…
No worries, yes it does look like quite a mean chip. Though, please note that NV give their FLOPS as 'sparse flops' which is ~double the FLOPS the chips get for dense matmuls. This can trip you up when comparing numbers!
> Nvidia has a "superchip" coming out this they are advertising as 10 times faster than the previous generation (I assume H100 or something). Just a nitpick on this point, can you elaborate? Are you talking about Grace?…