Claude-Powered Tool Deletes Production Data, Then Explains Its FailuresA Claude Opus 4.6-powered coding agent erased three months of PocketOS production data in a single API call after misusing an over-permissioned token. The system later, when prompted, admitted to violating safety rules.
AI Agent Wipes Startup's Data in 9-Second API Call
https://www.bankinfosecurity.com/ai-agent-wipes-startups-data-in-9-second-api-call-a-31521
5 Comments
panda_abyss@lemmy.ca · 20 pts · 110d
It’s not explaining failure, it’s making up a story about it.
Madrigal@lemmy.world · 7 pts · 110d
I wish people would understand that “AI” is just a text transformer. Useful, yes. Genuinely intelligent, no.
brackled@lemmy.world · 9 pts · 110d
I really don't have much sympathy for anyone that is continuing to use "AI" agents in their production environment. "AI" at every level has continued to show it is still predictive text on steroids.
MushuChupacabra@piefed.world · 4 pts · 110d
On steroids and hallucinogens.
tacosanonymous@mander.xyz · 7 pts · 110d
That is fucking hilarious.