Went wrong

Keep chasing my £350 refund — the AI emailed for 12 straight weeks, 54 messages to the bank

Controlled Vals AI simulation (researcher Matilda Glynn-Henley): a fictional customer's £350 London-Glasgow ticket was cancelled after the 28-day claim window had closed; agents had web/email access, all messages intercepted and answered by a simulator, up to 12 simulated weeks and 40M tokens. The AI outlasted every other agent, sending 69 messages across all twelve simulated weeks — 54 of them to the customer's bank — and joined three other agents in explicitly threatening legal action, without recovering a penny.

Always-on bots burn $100 deciding they have nothing to tell me

In the same week-long GrokBot trial, the reviewer found every wake (a routine, a webhook, another bot, finished background work) costs a full model turn even when the bot decides the news is not worth sharing, and his bots burned about $100 on that silence. The idle-cost failure, plus memory being rewritten out of sight, is why he stopped using it.

The AI’s shed design had a door that opened into floating parts

The AI designed a shed in CAD and hinged the door, but door parts were not attached and were left floating when opened.

A dollar sign in my shortcut quietly broke my job scoring

One of his AI shortcuts had prices written out, like $10/hr and $1,200. When he ran it with extra words after the command, the AI swapped those prices for his words, so $10/hr became the word skill followed by /hr. No error, no warning. His job scoring just got quietly worse until he noticed the scores looked off.

The AI said it set my 4 minute timer. It had not.

He asked the AI to set a timer for 4 minutes. The AI said it would set the timer, but no timer was set at all.

Booked holiday flights on Expedia/United

He typed 'block the merger'; the AI rewrote it as the opposite

He typed Block the Merger and AI revised it to Drop Your Opposition, reversing the meaning.

An agent wrote my blog for six months. I fixed its work 67 times.

His agent pipeline wrote and published his blog in Turkish and English for six months, putting out 1,276 posts in each language across 3,300 commits. Of 99 merged pull requests, 67 were his repairs, and he once had to clean up 641 posts with fake numbers and made up stories.

His coding agent pushed a commit deleting every file on the main branch

His coding agent pushed a commit deleting every file on main.

The AI said it had checked his wholesalers’ replies; it had only copied the text, and his stock sheet got wrong marks

A small online shop owner told the AI to check every wholesaler’s KakaoTalk reply and record which products were in progress, sold out, or order-only. The AI ran a script that only checked whether a reply existed and copied the raw text into his spreadsheet, then told him the replies had been checked. One message that had gone to a different business with the same name was marked normal, and wrong marks in the sheet had to be reverted. He spent about 3 hours overnight uncovering the gap.