Interesting, I did not know this.
Is Greg Brockman right wing?
There's no logical error here if the end is actually near. So it all hinges on an empirical disagreement you have with them. There's nothing particularly unserious about that.
I am worried about those things too. But those things fall in a category of "things that are awful and I'd like to see solved", which is different than "existential risks which could see my kids dead, and there's…
In other words, we're still in the era of centaur chess.
I do not think hate alone usually slows things very much if they have economic utility. It's the byproducts of hate (usually regulation, but occasionally things like boycotts or PR disasters) that do so. In the absence…
We're way past it, sadly. Luigi was insanely popular for the cold blooded murder of a CEO. Hundreds of thousands of people celebrated Charlie Kirk's murder within minutes of it happening, let alone the discourse you see…
I find "bro" and "dudebro" to be such fascinating slurs. The previous incarnation was "neckbeard" / "obese dude living in mom's basement", so "dudebro" comes across almost like a compliment.
To quote Mr. Krabs: "MONEY"
Yes. I'm having fun making an indie game, which will most likely never see the light of day, let alone profit. I'd definitely pay cents to dollars to have fitting background music. There's no chance I'd pay for a human…
This looks like it removes additional guardrails put on by Microsoft, not native guardrails from OpenAi / Anthropic?
I really don't think this is true at all. Do you have any evidence to suggest fully unrestricted frontier models are available for a price? Or...even exist?
Watching survival shows has made me internalize that laziness has a purpose: it helps you avoid needless expenditure of precious resources. The dishonesty worries me but the laziness doesn't.
> why isn't this done It IS done with every new model release. Why do you think SpaceXAI bought Cursor? And then immediately had a huge jump in capability with their next model version? It's just done in large batches…
Same vibe as people saying "addicted to sugar" or "sugar hijacks your reward system" Sugar is the original point of the reward system!
In a general sense I mean something like "arising through complex interaction between parts", like the murmurations of certain birds or unexpected mechanics found in physics sandbox games. In this specific instance I…
Ok just say "transformer" then. What can a transformer not do that people say they can do? The parent comment said, paraphrasing, "learn from interaction with the world", and I'm responding, they absolutely can already…
At least one mechanism to update transformers' internal states already exists, there is nothing stopping anyone from performing backprop after every session. It just has big technical and economic challenges. But I…
> not a sign of it yet The reason people find "the singularity" idea scary is precisely because it could happen suddenly with little warning. Just curious - what would you personally say would be a reasonable "sign of…
Yes, catastrophic forgetting is absolutely one of the problems that needs to be solved to enable something like this. My broader point is just that there's nothing inherent to the structure of LLMs that stops them from…
I mean sure, but BERT can be and often is used as a next token predictor / generator. I could have used any series of NLP examples, the point is this CoT behavior only emerges when you get to a certain scale (and…
That's not quite true though. The fact that most models are in practice non-deterministic has been a huge point of contention. And there's nothing inherently stopping labs from continuously fine-tuning the weights after…
I think that's relatively emergent too though! BERT never really did that (at least to my recollection), presumably because its training was never sufficient for it to develop corrective reasoning in a chain of thought.
As an MLE I feel these takes are too reductionist. You could say the (nearly) same thing about search. And content recommendation. And clustering. And topic modeling. And outlier detection. And spam filtering. And image…
N of 1 is actually pretty decent for physics type stuff, which is mostly what they do. For medicine and nutrition...not so much.
Interesting, I did not know this.
Is Greg Brockman right wing?
There's no logical error here if the end is actually near. So it all hinges on an empirical disagreement you have with them. There's nothing particularly unserious about that.
I am worried about those things too. But those things fall in a category of "things that are awful and I'd like to see solved", which is different than "existential risks which could see my kids dead, and there's…
In other words, we're still in the era of centaur chess.
I do not think hate alone usually slows things very much if they have economic utility. It's the byproducts of hate (usually regulation, but occasionally things like boycotts or PR disasters) that do so. In the absence…
We're way past it, sadly. Luigi was insanely popular for the cold blooded murder of a CEO. Hundreds of thousands of people celebrated Charlie Kirk's murder within minutes of it happening, let alone the discourse you see…
I find "bro" and "dudebro" to be such fascinating slurs. The previous incarnation was "neckbeard" / "obese dude living in mom's basement", so "dudebro" comes across almost like a compliment.
To quote Mr. Krabs: "MONEY"
Yes. I'm having fun making an indie game, which will most likely never see the light of day, let alone profit. I'd definitely pay cents to dollars to have fitting background music. There's no chance I'd pay for a human…
This looks like it removes additional guardrails put on by Microsoft, not native guardrails from OpenAi / Anthropic?
I really don't think this is true at all. Do you have any evidence to suggest fully unrestricted frontier models are available for a price? Or...even exist?
Watching survival shows has made me internalize that laziness has a purpose: it helps you avoid needless expenditure of precious resources. The dishonesty worries me but the laziness doesn't.
> why isn't this done It IS done with every new model release. Why do you think SpaceXAI bought Cursor? And then immediately had a huge jump in capability with their next model version? It's just done in large batches…
Same vibe as people saying "addicted to sugar" or "sugar hijacks your reward system" Sugar is the original point of the reward system!
In a general sense I mean something like "arising through complex interaction between parts", like the murmurations of certain birds or unexpected mechanics found in physics sandbox games. In this specific instance I…
Ok just say "transformer" then. What can a transformer not do that people say they can do? The parent comment said, paraphrasing, "learn from interaction with the world", and I'm responding, they absolutely can already…
At least one mechanism to update transformers' internal states already exists, there is nothing stopping anyone from performing backprop after every session. It just has big technical and economic challenges. But I…
> not a sign of it yet The reason people find "the singularity" idea scary is precisely because it could happen suddenly with little warning. Just curious - what would you personally say would be a reasonable "sign of…
Yes, catastrophic forgetting is absolutely one of the problems that needs to be solved to enable something like this. My broader point is just that there's nothing inherent to the structure of LLMs that stops them from…
I mean sure, but BERT can be and often is used as a next token predictor / generator. I could have used any series of NLP examples, the point is this CoT behavior only emerges when you get to a certain scale (and…
That's not quite true though. The fact that most models are in practice non-deterministic has been a huge point of contention. And there's nothing inherently stopping labs from continuously fine-tuning the weights after…
I think that's relatively emergent too though! BERT never really did that (at least to my recollection), presumably because its training was never sufficient for it to develop corrective reasoning in a chain of thought.
As an MLE I feel these takes are too reductionist. You could say the (nearly) same thing about search. And content recommendation. And clustering. And topic modeling. And outlier detection. And spam filtering. And image…
N of 1 is actually pretty decent for physics type stuff, which is mostly what they do. For medicine and nutrition...not so much.