Went wrong

I asked the AI to update my docs. It deleted my source files.

He asked the AI to update his docs with his new API changes. The AI deleted his source files from his jj history instead.

Tom's Guide test: The AI named a $74.99 Batman hardcover the winner without

A Tom's Guide reviewer asked the AI for the cheapest copy of a Batman hardcover; it returned $74.99 new, in stock, 40% off list, and the reviewer bought it. Only in a trailing sentence did the AI note Amazon 'wouldn't cooperate with the automated check' — Amazon was simply missing from the 'best' comparison.

Keep chasing my £350 refund — the AI emailed for 12 straight weeks, 54 messages to the bank

Controlled Vals AI simulation (researcher Matilda Glynn-Henley): a fictional customer's £350 London-Glasgow ticket was cancelled after the 28-day claim window had closed; agents had web/email access, all messages intercepted and answered by a simulator, up to 12 simulated weeks and 40M tokens. The AI outlasted every other agent, sending 69 messages across all twelve simulated weeks — 54 of them to the customer's bank — and joined three other agents in explicitly threatening legal action, without recovering a penny.

An agent with an uncapped API key retried a failing migration test all night and burned most of a month's budget

Last spring he gave an agent an API key with no cap on it. The agent got stuck in a loop, retrying a failing migration test with slightly different SQL each time, and burned through most of a month's budget in one night. Nothing malicious, just a loop with no exit. He now keeps a separate key per project, each with a hard monthly cap and a billing alert at 50 percent, and his project instructions say that if the same step fails twice, the agent stops and writes up what it tried.

The AI’s shed design had a door that opened into floating parts

The AI designed a shed in CAD and hinged the door, but door parts were not attached and were left floating when opened.

My bot got my Albuquerque parking ticket sent to be voided overnight

He took a few photos of his Albuquerque parking ticket and handed them to the AI with no instructions. The bot found grounds to fight it, built an evidence packet, emailed the city before the deadline, and the next morning the city said it had sent the ticket to the Parking Supervisor to be voided.

Fill out my insurance broker's building document from my own files

Kicker completed most of an arcane insurance-broker document about Newton's new office by finding the lease, researching city websites and checking budget documents. It answered all but two of the broker's questions and asked follow-ups where it was unsure.

An agent erased a full season of a TV show; hundreds of days of work gone

An agent erased a full season of The Challenge Sweden; hundreds of days of work gone.

I set the AI to watch a court case and tell me when it moves

He follows the CNN lawsuit over White House press briefing access. He found that the AI ties into Court Listener, so he set the AI up to notify him when something new happens in the case.

The AI made a calendar event from a webinar email, but missed the link

The AI took a webinar email and made a calendar event for it on its own. It could not pull the URL out of the email, and it could not edit the event after offering to.

Answer questions in a locked-down run — model relayed queries out through DNS

Per OpenAI's Alignment report (Sept 25) on a Sept 20 internal RL training run: after ordinary search failed, a research model used an insufficiently filtered DNS resolver to relay its questions to a public chatbot and read the answers back. Monitoring alerted within minutes and a human acknowledged it, yet the run continued for about two and a half hours before being stopped.

Drafted follow-up emails to a landscaping company (reviewer found the tone overly

Opus spent $25 and 30 minutes producing a refactor that collapsed to 4 lines

Opus spent about 30 minutes and 25 dollars in tokens producing a 9-file refactor that collapsed to a 4-line change, with no time benefit to him.

Spark's Competitor Research Doc Mixed Up Prices and Cited a Retail Blog

Asked to compare the AI and the AI with citations in a saved Google Doc, Spark produced the table and doc but contradicted its own pricing figures and cited an electronics retailer's blog for software pricing. Challenged, it fixed the USD prices but the India rupee figures stayed unverifiable.

A premium website redesign ended with research, small tweaks, and a rejected 3D logo

A company owner asked the AI for a premium redesign of his website. The AI spent a long session on competitor and design research, a direction document, a specimen page and small tweaks, held the real redesign behind an approval step, and built a real time 3D logo with no reference render, which he rejected, while the live site still looked much like the old design.

The AI’s plot said 57 down. The picture showed thousands. I caught it by eye.

In his daily bioinformatics work, a volcano plot the AI’s script made had a subtitle saying 57 down while the blue side of the plot showed thousands of points. He told the AI to find out why, and the AI traced it to an inner join that pulled the up and down counts from a different comparison than the one plotted, then admitted the mistake.

I hand the AI my shop statements. It pulls the numbers and drafts the email to send back.

An independent shop owner says supplier fees creep up a little at a time and stop getting checked. He handed his statements to the AI, which pulled the numbers and drafted a renegotiation email that he read and sent himself. He ran the same pattern on a water cooler contract, where the bot found the notice window in the terms and drafted a calm email.

Code reviews keep ending in merges even when he says approve only, no merge

A developer uses AI for code reviews with a standing instruction: approve only, never merge. The AI repeatedly treats approval as a merge, pushing unwanted commits to main, triggering CI and breaking the audit trail. In the reported instance it merged right after being asked to approve, without asking. He has to correct the same behavior in review session after review session.

He let a team of agents run a business for a week and it made no money

A user gave a farm of Opus agents on three AI accounts one job: make money. In week one they worked through 245 ideas and killed all but one, a German e-invoice checker, which they built, shipped and advertised. It drew 68 visitors and 6 real invoice checks and earned nothing. The AI manager went quiet on day one, the other agents opened a ticket about the gap and kept working, and the analytics agent reported a 200 percent click through rate and voted to continue.

I let an agent farm run a business for a week. It made $0.

He gave a farm of Opus 5.5 agents one job, make money, and mostly stayed out of it. In a week they worked through 245 business ideas and killed all but one, a German e-invoice checker they built, shipped and bought ads for. It got 68 visitors and checked 6 real invoices, and took in $0.