> And what might be the outcome? DoE compute budgets are ~10B USD across labs. AI training is a trillion-dollar workload. Different league.
All that would not help you with an AI training cluster interconnect. See Amin Vahdat's keynote at HotInterconnects 2025. Everyone is building a fabric for this stuff from scratch (Google/Falcon, Amazon/EFA, Azure/MANA,…
Today's limits are known and undisputable. Tomorrow's limits are a promise: some promises over-deliver, others under-deliver. :) Regardless, to bring the discussion back to the claim at hand: at all points in future, we…
> With alzheimer's an autopsy can tell for sure but that's not much help for a patient. Ok let us unpack this statement. For your point to hold, I would have to be saying "all kinds of practical diagnostics are invented…
Pyschiatry gets complicated because the failures are not mechanical. Even if you could image every single neuron in a person's head we do not have a very good way to define an algorithm for these issues. I do not have a…
> I think „the diagnosis” is over simplification and lots of professionals would disagree that there’s always a single one. "The Diagnosis" does not mean "one root cause". Situation: my car has some unexplained…
> There is no guarantee that the LLM will help you converge on anything. Absolutely. The guarantee does not come from the LLM. The LLM is a simply an improved version of Google Search. The guarantee can only come from a…
Yeah I think the OP is muddling the point by conflating "physician's version of the diagnosis" with "The Diagnosis". There is absolutely one "The Diagnosis". Human body is a machine, albeit a very complex one, and all…
Maybe I am missing something but I just find this wrong. Everything is a puzzle: there is one "Truth" or one diagnosis. You (a smart human) should be able to converge on it by cross-examining your LLMs. By themselves,…
As someone who graduated with a 7.5 year long PhD last month, I feel like PhD stipends are not a major problem. Like I got $40K in a low CoL area, but accounting for tuition and overheads I cost my advisor closer to…
That training is compute-bound and inference is memory-bound is well-known, but I don't think Nvidia deployments typically specialize for one vs the other. One reason is that most clouds/neoclouds don't own workloads,…
MapReduce is nice but it doesn't, by itself, help you reason about pushdowns for one. Parquet, for example, can pushdown select/project/filter, and that's lost if you have MapReduce. And a reduce is just a shuffle +…
Algebras are also nice for implementations. If you can decompose a domain into a few algebraic primitives you can write nice SIMD/CUDA kernels for those primitives. To your point, I wonder if the 73 distinct transforms…
Yes, GPT5-series thinking models are extremely pedantic and tedious. Any conversation with them is derailed because they start nitpicking something random. But Codex/5.2 was substantially more effective than Claude at…
While Arrow is amazing, it is only the C Data Interface that can be FFI'ed, which is pretty low level. If you have something higher-level like a table or a vector of recordbatches, you have to write quite a bit of FFI…
Yeah unfortunately no amount of manoeuvering is a substitute for a kill chain where a distributed web of sensors and relays and weapon carriers can result in an AAM being dispatched from any direction at lightspeed.
The appropriate comparison point for aggregate cluster storage bandwidth would be its bisection bandwidth. (I do HPC, IIRC ANL Aurora is < 1PB/s DAOS and 20 PB/s bisection).
I think I'm talking about cluster-scale network bisection bandwidth vs attached storage bandwidth. With replication/erasure coding overhead and the economics, the order of magnitude difference still prevails. I think…
Yep I think the value of the experiment is not clear. You want to use Spark for a large dataset with multiple stages. In this case, their I/O bandwidth is 1GB/s from S3. CPU memory bandwidth is 100-200GB/s for a…
> LDL-C is much much cheaper to measure. ApoB costs 36x times as much, so Insurance Companies don't like to pay for it Unfortunately American retail prices might as well be generated by a PRNG, and do not mean much. On…
Maybe 80-90% of people should take doctors at face value, but it is easy and only getting easier to at least access the knowledge to better advocate for your own healthcare (thanks to LLMs), with better outcomes. Of…
Same, I don't understand the complaints against modern C++. A lambda, used for things like comparators etc, is much simpler than structs with operators overloaded defined elsewhere. My only complaint is the verbosity,…
> Getting 200 Gb/s of reliable in-order bytestream per core over a unreliable, out-of-order packet-switched network using standard ethernet is not very hard with proper protocol design. You also suggested that this can…
> Is this just a cost efficiency thing? It's not entirely, but even that would be a justifiable reason. Tail behavior of all sorts matters a lot, sophisticated congestion control and load-balancing matters a lot. ML…
Yes, unfortunately even the best intentioned individuals have very limited ability to make meaningful carbon-minimizing decisions. Carbon tax is such a sensible solution!
> And what might be the outcome? DoE compute budgets are ~10B USD across labs. AI training is a trillion-dollar workload. Different league.
All that would not help you with an AI training cluster interconnect. See Amin Vahdat's keynote at HotInterconnects 2025. Everyone is building a fabric for this stuff from scratch (Google/Falcon, Amazon/EFA, Azure/MANA,…
Today's limits are known and undisputable. Tomorrow's limits are a promise: some promises over-deliver, others under-deliver. :) Regardless, to bring the discussion back to the claim at hand: at all points in future, we…
> With alzheimer's an autopsy can tell for sure but that's not much help for a patient. Ok let us unpack this statement. For your point to hold, I would have to be saying "all kinds of practical diagnostics are invented…
Pyschiatry gets complicated because the failures are not mechanical. Even if you could image every single neuron in a person's head we do not have a very good way to define an algorithm for these issues. I do not have a…
> I think „the diagnosis” is over simplification and lots of professionals would disagree that there’s always a single one. "The Diagnosis" does not mean "one root cause". Situation: my car has some unexplained…
> There is no guarantee that the LLM will help you converge on anything. Absolutely. The guarantee does not come from the LLM. The LLM is a simply an improved version of Google Search. The guarantee can only come from a…
Yeah I think the OP is muddling the point by conflating "physician's version of the diagnosis" with "The Diagnosis". There is absolutely one "The Diagnosis". Human body is a machine, albeit a very complex one, and all…
Maybe I am missing something but I just find this wrong. Everything is a puzzle: there is one "Truth" or one diagnosis. You (a smart human) should be able to converge on it by cross-examining your LLMs. By themselves,…
As someone who graduated with a 7.5 year long PhD last month, I feel like PhD stipends are not a major problem. Like I got $40K in a low CoL area, but accounting for tuition and overheads I cost my advisor closer to…
That training is compute-bound and inference is memory-bound is well-known, but I don't think Nvidia deployments typically specialize for one vs the other. One reason is that most clouds/neoclouds don't own workloads,…
MapReduce is nice but it doesn't, by itself, help you reason about pushdowns for one. Parquet, for example, can pushdown select/project/filter, and that's lost if you have MapReduce. And a reduce is just a shuffle +…
Algebras are also nice for implementations. If you can decompose a domain into a few algebraic primitives you can write nice SIMD/CUDA kernels for those primitives. To your point, I wonder if the 73 distinct transforms…
Yes, GPT5-series thinking models are extremely pedantic and tedious. Any conversation with them is derailed because they start nitpicking something random. But Codex/5.2 was substantially more effective than Claude at…
While Arrow is amazing, it is only the C Data Interface that can be FFI'ed, which is pretty low level. If you have something higher-level like a table or a vector of recordbatches, you have to write quite a bit of FFI…
Yeah unfortunately no amount of manoeuvering is a substitute for a kill chain where a distributed web of sensors and relays and weapon carriers can result in an AAM being dispatched from any direction at lightspeed.
The appropriate comparison point for aggregate cluster storage bandwidth would be its bisection bandwidth. (I do HPC, IIRC ANL Aurora is < 1PB/s DAOS and 20 PB/s bisection).
I think I'm talking about cluster-scale network bisection bandwidth vs attached storage bandwidth. With replication/erasure coding overhead and the economics, the order of magnitude difference still prevails. I think…
Yep I think the value of the experiment is not clear. You want to use Spark for a large dataset with multiple stages. In this case, their I/O bandwidth is 1GB/s from S3. CPU memory bandwidth is 100-200GB/s for a…
> LDL-C is much much cheaper to measure. ApoB costs 36x times as much, so Insurance Companies don't like to pay for it Unfortunately American retail prices might as well be generated by a PRNG, and do not mean much. On…
Maybe 80-90% of people should take doctors at face value, but it is easy and only getting easier to at least access the knowledge to better advocate for your own healthcare (thanks to LLMs), with better outcomes. Of…
Same, I don't understand the complaints against modern C++. A lambda, used for things like comparators etc, is much simpler than structs with operators overloaded defined elsewhere. My only complaint is the verbosity,…
> Getting 200 Gb/s of reliable in-order bytestream per core over a unreliable, out-of-order packet-switched network using standard ethernet is not very hard with proper protocol design. You also suggested that this can…
> Is this just a cost efficiency thing? It's not entirely, but even that would be a justifiable reason. Tail behavior of all sorts matters a lot, sophisticated congestion control and load-balancing matters a lot. ML…
Yes, unfortunately even the best intentioned individuals have very limited ability to make meaningful carbon-minimizing decisions. Carbon tax is such a sensible solution!