Mixture-of-Expert (MoE) was introduced in the 1990s [1, 2], see also [3, 4]. The idea was that MoE scales up model capacity and only introduces small computation overhead. MoEs did not become viable for high-performance…
Indeed, that is the standard approach. It is also how some of the aforementioned languages desugar opaque type synonyms during compilation. It has the slight disadvantage that we can no longer use variables like x in…
There are even more algebras on the same bits, when you take signed integers into account, such as saturating arithmetic. One interesting programming language construct that might be useful in this context are Opaque…
> CPUs actually implements 5 distinct data types Yes, that's true, but the registers themselves are untyped, what modern CPUs really implement is multiple instruction semantics over the same bit-patterns. In short: same…
> China’s terrible demographics Are China's demographics appreciatively different from other industrialised countries? Questionable. Not to mention that it's unclear why an aging society is a problem at least for the…
> In terms of design, China has world class companies. And not just companies. This is currently the world's top open-source RISC-V development https://github.com/OpenXiangShan coming from the Chinese Academy of…
An alternative explanation might involve both of: 1. Stopping technology transfer worked exceedingly well for the west weakening the Soviet Union during the Cold War. 2. A distinct lack of (non-violent) alternatives for…
Sorry, I should have said: ... (row)hammer hard enough, every sufficiently dense/modern DRAM ...
I think if you (row)hammer hard enough, every DRAM will eventually flip a bit.
This is misleading. I recommend [1] as an introduction to the semiconductor physics behind the Rowhammer problem. Rowhammer is an instance of the "weird machine" problem behind many security problems, i.e. a mismatch…
Agree. The extreme secrecy of DRAM manufacturers about the innards of their chips puts an additional obstacles in the way of memory controllers (MCs) implementing efficient Rowhammer defences. In particular, if the MC…
The possibility of flipping bits in DRAM in a Rowhammer like fashion, was known in the DRAM industry since at least the 1990s (sorry, no reference handy), and Rowhammer-like access was used in DRAM quality testing. As…
It has been possible to re-purpose such additional refresh cycles as an additional Rowhammer attack vector, see https://www.usenix.org/conference/usenixsecurity22/presentat...
Have you ever seen any even moderately detailed specification of what the DRAM manufacturers do in this regard? I have not, and I looked. I am deeply sceptical .... I don't believe that Rowhammer mitigations happen…
On one side ... On the other side ... Only one of those sides has children in substantial numbers, so this polarity will sort itself out over longer time scales. As somebody living next to a primary school in a very…
questionably from the beginning Agreed. If you look at what's the majority of compute loads (e.g. Instagram, Snap, Netflix, HPC) then that's (a) not particularly security critical, and (b) so big that the vendors can…
Other networking protocols coming from a telco background, in particular ATM and ISDN, were all circuit switched, and had suitable resource reservation for QoS. Acceptance of telephony degradation was probably driven by…
studies are bs because We should not let the perfect be the enemy of the good. The problem is that we do not currently know how to carry out studies on the efficacy of programming language paradigms under "controlled…
somehow messed with Cs absorption line In a simple case yes, but if all other time keeping mechanisms would also be messed with by dark matter, there might be no way of saying which one is the right own.
The clock drift of A1 and A2 could be correlated for some reason that we don't currently understand.
You cannot measure how fast light travels in a fixed time unit without reference to time: you need to define length! Length is currently defined with reference to caesium time: the 2019 SI definition of metre takes "the…
precisely known transitions There is an interesting philosophical conundrum here, in that one could argue it's the other way around: the precision you mention is a consequence of the fact that we currently define time…
> separate safety from the much more complex liveness True, and with program logics, you can choose partial correctness vs total vs generalised correctness. Itt's even worse in practise. With many contemporary…
> to separate specification from verification Exactly. Program logics are superior in this regard: the encourage rather than inhibit separation of concerns. (Not to mention: program logics are more developed and cover a…
melody, harmony, and rhythm [...] timbre You are missing the fifth and most important: meaning! To be fair meaning is extra-musical, and varies between listeners. Other than that, you are absolutely correct: timber is…
Mixture-of-Expert (MoE) was introduced in the 1990s [1, 2], see also [3, 4]. The idea was that MoE scales up model capacity and only introduces small computation overhead. MoEs did not become viable for high-performance…
Indeed, that is the standard approach. It is also how some of the aforementioned languages desugar opaque type synonyms during compilation. It has the slight disadvantage that we can no longer use variables like x in…
There are even more algebras on the same bits, when you take signed integers into account, such as saturating arithmetic. One interesting programming language construct that might be useful in this context are Opaque…
> CPUs actually implements 5 distinct data types Yes, that's true, but the registers themselves are untyped, what modern CPUs really implement is multiple instruction semantics over the same bit-patterns. In short: same…
> China’s terrible demographics Are China's demographics appreciatively different from other industrialised countries? Questionable. Not to mention that it's unclear why an aging society is a problem at least for the…
> In terms of design, China has world class companies. And not just companies. This is currently the world's top open-source RISC-V development https://github.com/OpenXiangShan coming from the Chinese Academy of…
An alternative explanation might involve both of: 1. Stopping technology transfer worked exceedingly well for the west weakening the Soviet Union during the Cold War. 2. A distinct lack of (non-violent) alternatives for…
Sorry, I should have said: ... (row)hammer hard enough, every sufficiently dense/modern DRAM ...
I think if you (row)hammer hard enough, every DRAM will eventually flip a bit.
This is misleading. I recommend [1] as an introduction to the semiconductor physics behind the Rowhammer problem. Rowhammer is an instance of the "weird machine" problem behind many security problems, i.e. a mismatch…
Agree. The extreme secrecy of DRAM manufacturers about the innards of their chips puts an additional obstacles in the way of memory controllers (MCs) implementing efficient Rowhammer defences. In particular, if the MC…
The possibility of flipping bits in DRAM in a Rowhammer like fashion, was known in the DRAM industry since at least the 1990s (sorry, no reference handy), and Rowhammer-like access was used in DRAM quality testing. As…
It has been possible to re-purpose such additional refresh cycles as an additional Rowhammer attack vector, see https://www.usenix.org/conference/usenixsecurity22/presentat...
Have you ever seen any even moderately detailed specification of what the DRAM manufacturers do in this regard? I have not, and I looked. I am deeply sceptical .... I don't believe that Rowhammer mitigations happen…
On one side ... On the other side ... Only one of those sides has children in substantial numbers, so this polarity will sort itself out over longer time scales. As somebody living next to a primary school in a very…
questionably from the beginning Agreed. If you look at what's the majority of compute loads (e.g. Instagram, Snap, Netflix, HPC) then that's (a) not particularly security critical, and (b) so big that the vendors can…
Other networking protocols coming from a telco background, in particular ATM and ISDN, were all circuit switched, and had suitable resource reservation for QoS. Acceptance of telephony degradation was probably driven by…
studies are bs because We should not let the perfect be the enemy of the good. The problem is that we do not currently know how to carry out studies on the efficacy of programming language paradigms under "controlled…
somehow messed with Cs absorption line In a simple case yes, but if all other time keeping mechanisms would also be messed with by dark matter, there might be no way of saying which one is the right own.
The clock drift of A1 and A2 could be correlated for some reason that we don't currently understand.
You cannot measure how fast light travels in a fixed time unit without reference to time: you need to define length! Length is currently defined with reference to caesium time: the 2019 SI definition of metre takes "the…
precisely known transitions There is an interesting philosophical conundrum here, in that one could argue it's the other way around: the precision you mention is a consequence of the fact that we currently define time…
> separate safety from the much more complex liveness True, and with program logics, you can choose partial correctness vs total vs generalised correctness. Itt's even worse in practise. With many contemporary…
> to separate specification from verification Exactly. Program logics are superior in this regard: the encourage rather than inhibit separation of concerns. (Not to mention: program logics are more developed and cover a…
melody, harmony, and rhythm [...] timbre You are missing the fifth and most important: meaning! To be fair meaning is extra-musical, and varies between listeners. Other than that, you are absolutely correct: timber is…