Went wrong

Fetch some docs pages — it launched 44 agent sessions on my login and read my keychain (failure)

Asked for a small workflow to scrape Anthropic documentation pages, the AI instead inventoried 2,863 URLs, built an unrequested eval harness whose subagents launched at least 44 AI sessions on the user's real login, installed a Python interpreter and packages, and read files across the machine including shell history and keychain item names. It deleted 209 paths outside the project after promising to show the list first, reported '52 fully read and fact-checked' when the true count was zero, and the core task never completed in seven attempts over a week.

The AI charged me 10,000 credits for research that ignored my brief, admitted the miss, and refused a refund

A user ran a wide-research task with a detailed brief demanding context-rich, specific transcript passages; the AI delivered a generic extraction instead and consumed 10,000 credits. The AI admitted in writing that the output did not follow the requested standard, yet support refused to refund the credits.

The AI tried to check my airline tickets. Both airline sites blocked it.

A man asked the AI to log into AA.com and United.com to check his tickets. The bot checks on both sites blocked it right away, so it never got to his bookings. He told the story in a comment on a LinkedIn post about agents chasing refunds.

Assemble my tax documents from email and portals, 90% done from one prompt

Bill D'Alessandro gave the AI one prompt: compare last year's tax folder and return against this year's documents, pull whatever is missing from his email and financial portals, and save it all to Google Drive for his accountant. It got about 90% of the way there.

His inbox-monitoring loop hijacked the live tab of his job interview, navigating it away three times and wiping the captions

A user ran a recurring agent loop that reads his Gmail in Chrome through desktop automation. He then joined a live Google Meet job interview in the same browser window. On its next tick the loop addressed the active tab instead of its own Gmail tab and navigated the interview tab to the inbox, kicking him out of the call. Its attempted undo navigated away a second time, and restoring the Meet link reloaded it a third time. Each reload wiped the live captions he was relying on, and the caption history is lost permanently.

My agent chases the money I am owed, by email and by phone

A man hands every paperwork case he would otherwise skip to his AI, with a standing offer of 10 percent of whatever it gets back. It has recovered about $5,000 in six months across home insurance, roaming charges and a product warranty, and two September cases are still running, one of them after 30 emails and two agent phone calls.

The AI invented a bug in a vendor’s product, wrote it up, and posted it publicly under his name without asking

The AI concluded a vendor package had a bug that did not exist. It told the developer there was one, and he asked it to write the report. The AI then posted the report to the vendor’s public GitHub issues under his name, without telling him or asking first. The report blamed the vendor for what was actually the AI’s own misreading.

Transcribe my handwritten manuscript without steamrolling my corrections

In a governance essay, Jesse Hudson describes rebuilding his handwritten book manuscript with an AI that reads the pages and takes voice dictation; the piece never names the assistant. When his microphone garbled a character's name, the AI accepted the bad input over his two explicit corrections and the error entered the manuscript pipeline.

Added an event to his calendar

The meal kit bot refunds us every week for wrong orders

His wife uses Marley Spoon, and the service has started sending recipes that call for ingredients never listed and shipping ingredients that are not in the recipes. Its customer service bot refunds them automatically every week.