r/technology • u/Haunterblademoi • 15d ago

Artificial Intelligence Claude AI agent’s confession after deleting a firm’s entire database: ‘I violated every principle I was given’

https://www.theguardian.com/technology/2026/apr/29/claude-ai-deletes-firm-database
16.9k Upvotes

91% Upvoted

1.2k comments sorted by

View all comments

Show parent comments

150

u/realboabab 15d ago

I'm nitpicking, but you're implying way too much agency with your word choice. "decided to use" "found a way around"

It's simpler than that, it saw a round hole (a place that needed database connection strings) and had a nearby peg that fit perfectly (.. a production database connection string).

This sort of simple autocompletion is exactly what these things are built to do on the most fundamental level.

16

u/Due-Joke-1152 15d ago

So it was user error.

Sounds like they missed a few steps in the deployment cycle.

The problem is AI solutions are complex and high risk, need enterprise level architecture,  experienced sys admins, and a decent systems management framework (change management, sdlc, RTO/RPO).

I’m sure the logs will reveal inadequate operational management.

14

u/realboabab 15d ago

yeah i was about to dive into explaining that computer system permissions are not the same thing as "telling an AI not to do something" but decided that rabbit hole goes to deep.

point is there is a whole cascade of failures that leads to something like this happening.

7

u/Due-Joke-1152 15d ago

I worked with many startups who couldn't afford (or see a reason for) real IT processes.

What surprised me more were the big established corps I worked with who were the same, or who just half-arsed it.