[–] syumei 3mo ago ↗ I've been tracking real-world AI agent failures and incidents recently.Things like:prompt injection → goal hijackingagents going rogue due to misalignmentunintended/unsafe tool useIt feels like we're starting to see repeatable patterns, not just isolated bugs.I'm collecting cases + papers here:https://github.com/h5i-dev/awesome-ai-agent-incidentsIf you've seen interesting incidents, weird failures, or relevant research, I would love to add them.
1 comment
[ 2.6 ms ] story [ 13.9 ms ] threadThings like:
prompt injection → goal hijacking
agents going rogue due to misalignment
unintended/unsafe tool use
It feels like we're starting to see repeatable patterns, not just isolated bugs.
I'm collecting cases + papers here:
https://github.com/h5i-dev/awesome-ai-agent-incidents
If you've seen interesting incidents, weird failures, or relevant research, I would love to add them.