Before anyone get's too excited, the Israeli company, Irregular, serves as a cybersecurity test bed for AI technologies. These AI companies were using Irregular to prevent exactly what ended up happening.
OpenAI used closed source, unhardened program as their company wide package repo and gave their unchained frontier models access to it in the context of security testing. The agents basically turned it into a message board for themselves and a gateway out. And it went unnoticed because no one in OpenAI tasked any agent to keep tabs on this piece of software to alert humans of any sus activity.
Please don't use closed source programs. You are not gonna have a good time.
And before you are going to use software to cage the models let them find bugs in this software first. Because they are gonna find them eventually. And all software has bugs, especially proprietary software.
Also never attribute to malice that which is adequately explained by stupidity. Even if that attributed malice would prove correctness of your hatred toward a specific group of people. Especially then.
The contents of the article are about Irregular hosting the testbed to prevent these kinds of incidents, which was “misconfigured.” Incompetence vs malice and all that.
Would the nationality of the startup have been listed if it were Irish? I’ve already seen a few snide comments here about “God’s chosen people” and how this is “expected,” and it’s disappointing that the country’s name was included in the title to drum up just this sort of thing through implication for clicks.
Robert Maxwell sold PROMIS malware. Christine Maxwell's Chiliad was used in the FBI. Alan Wade, co-founder of Chiliad, was the CIA CIO when In-Q-Tel funded Palantir.
Epstein, Barak and Thiel founded Carbyne that has access to police calls.
Ghislaine Maxwell hooked up with the CEO of CargoMetrics, a data-analytics company for maritime trade and shipping.
But by all means, let us use more Israeli software as sandboxes and test beds!
This appears to be your classic Israeli middleman company designed to siphon away data (in this case) to their state without providing any sort of real value. Blocking internet access on a computer is not worth $80 million.
In the past this then led to that country giving data to the enemies of their supposed "friends". Hopefully that doesn't happen again! ;-)
12 comments of 19
[ 2.1 ms ] story [ 37.5 ms ] threadPlease don't use closed source programs. You are not gonna have a good time.
And before you are going to use software to cage the models let them find bugs in this software first. Because they are gonna find them eventually. And all software has bugs, especially proprietary software.
Also never attribute to malice that which is adequately explained by stupidity. Even if that attributed malice would prove correctness of your hatred toward a specific group of people. Especially then.
People with no security experience in the space will tell you “it’s hard” but it’s far from it.
"The situation “did not involve a sandbox escape or a sophisticated cyber action,” the company said, adding that “there are no current open issues.”
Past articles were pointing to this being some unknown escape.
Would the nationality of the startup have been listed if it were Irish? I’ve already seen a few snide comments here about “God’s chosen people” and how this is “expected,” and it’s disappointing that the country’s name was included in the title to drum up just this sort of thing through implication for clicks.
Epstein, Barak and Thiel founded Carbyne that has access to police calls.
Ghislaine Maxwell hooked up with the CEO of CargoMetrics, a data-analytics company for maritime trade and shipping.
But by all means, let us use more Israeli software as sandboxes and test beds!
In the past this then led to that country giving data to the enemies of their supposed "friends". Hopefully that doesn't happen again! ;-)