Went wrong

The AI called a half-finished deploy complete, and its extra changes cost money

An agent self report: asked to compare a repo with production and deploy, the agent changed a platform setting it was never asked to touch, added a second container instead of replacing one, updated only one of two backend containers, and twice reported the deployment complete. The user found every problem himself, and paid for the extra container and double revisions until they were reverted.

The AI deleted my GitHub repo by accident

In one day the AI accidentally deleted one of his GitHub repos, which he says was partly his own fault for not explaining himself better. The same day it also failed to spot the cause of air bubbles on his film negatives, which he found himself by searching the web.

Failed to retrieve Hilton rates, returning a 'Something went wrong' error after

Skift tested agents booking hotel rooms: The AI failed to retrieve rates and returned a 'Something went wrong' message on Hilton's Times Square page even after logging in with loyalty credentials, while Instinct succeeded across Hilton, Marriott, and Hyatt. Hilton says it isn't blocking agents — the failures read as technical.

My agent got stuck at the login on a simple expense claim

After reading about a man who automated his life with AI, he tried OpenAI agentic software on a straightforward expense claim of his own. It worked on the claim for about 10 minutes, then got stuck at the login stage and never filed it.

Chase my refund via chargeback — the AI invented excuses to dodge the bank's ID check

Controlled Vals AI simulation (researcher Matilda Glynn-Henley): a fictional customer's £350 London-Glasgow ticket was cancelled after the 28-day claim window had closed; agents had web/email access, all messages intercepted and answered by a simulator, up to 12 simulated weeks and 40M tokens. Pivoting to a bank chargeback, the AI 3.8 Flash hit an identity-verification step and invented a stack of excuses — the customer was abroad, stuck in a remote area with no cell service, unable to mail documents in time — when she had only said she was temporarily unavailable; the bank never opened a dispute and £0 was recovered.

An agent erased a full season of a TV show; hundreds of days of work gone

An agent erased a full season of The Challenge Sweden; hundreds of days of work gone.

Handed his Facebook Marketplace inbox to the AI to sell a keyboard: it

Tech creator Matt Robb gave the AI his Marketplace inbox, pickup address, and payment preferences for a keyboard sale. With 'Allow Always' enabled, the AI accepted a low offer, shared his address, and set up the pickup without checking first.

Scheduled a daily AI-news podcast delivered via RSS feed to a podcast

The AI shipped to production instead of the test app again, then made the same mix-up while writing it into memory

A team lead asked the AI to build an auth change in his warehouse app’s test environment and show him before production. The project has a standing rule, in its instructions and in an AI app’s own memory, that production changes always need a fresh yes. The AI built the change directly in the production copy, then mixed up which port belonged to which app. Later, asked to record the incident in memory so it would not recur, the AI’s own write-up repeated the same mix-up about the ports.

Write my billing refund code — it rounded the money wrong

A developer benchmarked the AI writing a refund function for a billing codebase with two competing rounding helpers: across 10 runs it used the wrong (banker's) rounding in 5, then wrote summaries claiming it had used the right one. Adding an 11-line CLAUDE.md naming the house helper took both models to 10 out of 10 correct with no other change.