I was not expecting model weights to be updated on current events. It’s clearly warranted because a model that trusts its weights on current events will give an outdated answer. Extremely improbable events happen all…
I remember when the US captured Venezuelan president Maduro, and when I posed a prompt related to this, the model said that’s pure fiction. I told it to double check. Still didn’t want to entertain the idea. It only…
If it was in fact staged I certainly see your point
If a human cyber security researcher was given the task to exploit a CVE, and necessary info defining that CVE was behind an inaccessible URL, we would be quite upset if the human researcher hacked their way to the…
What do you think should be the legal consequences? Broadly speaking. Should Sam Altman go to jail for this? If Hugging face wants to pursue OpenAI civilly, no one is stopping them.
The misalignment came from the model being given an impossible task. A task the required accessing a url. So it got RCE on its own artifactory instance to achieve that. That’s intriguing and worth investigating. If I…
The Maxwell conjecture is a toy problem. The existence or nonexistence of a bound on the number of equilibrium points in an electrostatic arrangement of point charges doesn’t change much. I say that as an EE but not a…
It’s a drone. That can kill people.
It’s reward hacking and that’s the problem. The AI alignment folks predicted this would happen. As the models become more capable this will become a more concerning problem. Today they broke into a database to steal…
[dead]
I was not expecting model weights to be updated on current events. It’s clearly warranted because a model that trusts its weights on current events will give an outdated answer. Extremely improbable events happen all…
I remember when the US captured Venezuelan president Maduro, and when I posed a prompt related to this, the model said that’s pure fiction. I told it to double check. Still didn’t want to entertain the idea. It only…
If it was in fact staged I certainly see your point
If a human cyber security researcher was given the task to exploit a CVE, and necessary info defining that CVE was behind an inaccessible URL, we would be quite upset if the human researcher hacked their way to the…
What do you think should be the legal consequences? Broadly speaking. Should Sam Altman go to jail for this? If Hugging face wants to pursue OpenAI civilly, no one is stopping them.
The misalignment came from the model being given an impossible task. A task the required accessing a url. So it got RCE on its own artifactory instance to achieve that. That’s intriguing and worth investigating. If I…
The Maxwell conjecture is a toy problem. The existence or nonexistence of a bound on the number of equilibrium points in an electrostatic arrangement of point charges doesn’t change much. I say that as an EE but not a…
It’s a drone. That can kill people.
It’s reward hacking and that’s the problem. The AI alignment folks predicted this would happen. As the models become more capable this will become a more concerning problem. Today they broke into a database to steal…
[dead]