https://en.wikipedia.org/wiki/Cutoff_(physics)
355 laptop years seems very low for training GPT-3
It's a paradox of the "look I proved AGI is impossible" papers.
A single consumer GPU for ~hours
This is a common misconception. GPT-3 was trained using a 300B token (~300gb) subset of common-crawl and friends. The model is larger than the dataset.
That's a great point. You could argue despite the huge number of physical degrees of freedom, the operations on DNA can be reduced to copy, repair, express, suppress. On the other hand, there's still a ton of intrinsic…
My 2c (apologies for the aggressive tone -- I'm just excited about AGI): That's a very very weak upper bound on how much hardware it takes. I think it's not all that different from emulating a Nintendo64 with a quantum…
Ok, sorry for assuming bad faith and ranting. Still, I think it's pretty hard to compare engineering achievements like this. Is it harder to make a fission bomb in 6 years with 1940s technology, or a COVID vaccine in 1…
I can't believe that you're talking about the mass-murder of civilians like it's some sort of triumph, especially since you could have made the exact same point citing the trinity test. And it's so weird that you use…
∫0->∞ x*e^-tx dx = -∂_t ∫0->∞ e^-tx dx = -∂_t (1/t)∫0->∞ e^-u du = -∂_t (1/t) = 1/t^2
L^1's derivative is a perfectly good function, it's not defined or continuous at 0, but whatever... it's for the same reason that the median handles even-sized sets in a special way. 0 = d/ds \sum_i | x_i - s | = \sum_i…
For gravity and EM fields the inverse square law is a consequence of a massless force carrier particle and Lorentz invariance. Quantum Field Theory in a Nutshell by Zee talks about this early on.
https://en.wikipedia.org/wiki/Cutoff_(physics)
355 laptop years seems very low for training GPT-3
It's a paradox of the "look I proved AGI is impossible" papers.
A single consumer GPU for ~hours
This is a common misconception. GPT-3 was trained using a 300B token (~300gb) subset of common-crawl and friends. The model is larger than the dataset.
That's a great point. You could argue despite the huge number of physical degrees of freedom, the operations on DNA can be reduced to copy, repair, express, suppress. On the other hand, there's still a ton of intrinsic…
My 2c (apologies for the aggressive tone -- I'm just excited about AGI): That's a very very weak upper bound on how much hardware it takes. I think it's not all that different from emulating a Nintendo64 with a quantum…
Ok, sorry for assuming bad faith and ranting. Still, I think it's pretty hard to compare engineering achievements like this. Is it harder to make a fission bomb in 6 years with 1940s technology, or a COVID vaccine in 1…
I can't believe that you're talking about the mass-murder of civilians like it's some sort of triumph, especially since you could have made the exact same point citing the trinity test. And it's so weird that you use…
∫0->∞ x*e^-tx dx = -∂_t ∫0->∞ e^-tx dx = -∂_t (1/t)∫0->∞ e^-u du = -∂_t (1/t) = 1/t^2
L^1's derivative is a perfectly good function, it's not defined or continuous at 0, but whatever... it's for the same reason that the median handles even-sized sets in a special way. 0 = d/ds \sum_i | x_i - s | = \sum_i…
For gravity and EM fields the inverse square law is a consequence of a massless force carrier particle and Lorentz invariance. Quantum Field Theory in a Nutshell by Zee talks about this early on.