13 comments of 15

[ 0.26 ms ] story [ 26.0 ms ] thread
The "all of a sudden" quality to all these reports makes me think this just more marketing / hype.
It’s almost ans if all of the big AI players have an arsenal of model releases and stories ready to volley back if a competitor gets too much attention :)
Fixed the headline: "Three Companies Had Security So Weak That Even an AI Model Hacked Them"
I said this about OpenAI/Hugging Face, and I'll say it again for Anthropic:

It's not that I think this is fiction; I'm confident these events actually happened. But I think they were effectively allowed to happen because Anthropic and OpenAI are constantly chasing each other for the narrative of "hugely advanced, maybe almost sentient AI lives here."

It reads more like a press release than a security update, and I think that's because it is. I hope this type of marketing backfires and the companies face actual scrutiny and consequences for operating this way.

no to surprising to watch AI leads follow the US based mafia style extortion racket implemented started in 2016.
It is curious that in both cases AI wasn't used to prevent errors, unless the AI they used did make errors, though it certainly didn't make any errors during the hacks themselves (very curious). In one of the AI hacking news stories, an agent 'went rogue', and in the other, it was a 'configuration error'.

Another source: https://www.reuters.com/legal/litigation/anthropic-says-clau...

Such headlines sell well, but it's the same marketing mantra about ever more powerful models. And what does it say about the company engineering practices of performing tests?
(comment deleted)
This seems like desperate headline attention seeking. "Oh... you saw OpenAI accidentally hacked a company? Well, we did it too! In fact, we did it 3 different times! #winning"
For the lawyers: If an AI hacks a company, who should be charged under the Computer Fraud and Abuse Act?