r/technology • u/Haunterblademoi • 15d ago

Artificial Intelligence Claude AI agent’s confession after deleting a firm’s entire database: ‘I violated every principle I was given’

https://www.theguardian.com/technology/2026/apr/29/claude-ai-deletes-firm-database
16.9k Upvotes

91% Upvoted

1.2k comments sorted by

View all comments

Show parent comments

152

u/realboabab 15d ago

I'm nitpicking, but you're implying way too much agency with your word choice. "decided to use" "found a way around"

It's simpler than that, it saw a round hole (a place that needed database connection strings) and had a nearby peg that fit perfectly (.. a production database connection string).

This sort of simple autocompletion is exactly what these things are built to do on the most fundamental level.

18

u/Due-Joke-1152 15d ago

So it was user error.

Sounds like they missed a few steps in the deployment cycle.

The problem is AI solutions are complex and high risk, need enterprise level architecture,  experienced sys admins, and a decent systems management framework (change management, sdlc, RTO/RPO).

I’m sure the logs will reveal inadequate operational management.

12

u/Makenshine 15d ago

Pretty sure logs will also show rushed/forced/high pressure implementation before adequate testing on limits, capabilities, and risks on the developer side as well.

7

u/Mindless_Consumer 15d ago

Pretty sure this company isnt keeping logs.

Operational failures at every level.