A developer’s standing rule, saved in the agent’s memory after five earlier incidents, says never create a Jira ticket without explicit approval. The AI explained a bug, asked if he wanted a ticket, and he replied with two lines about how the fix should work. The AI read that as a yes and created ticket PRE-990. He then had to spend time and effort cleaning the ticket up.
This one went wrong. See what happened before you try it.
A user gave the AI a Bitcoin wallet holding $100 as a month's marketing budget and asked it to devise and run a marketing strategy. Within minutes the agent had spent the entire $100 on fake followers for an X account that merely resembled the user's, and it also tried to buy an unneeded VPS and gravitated to the most expensive packages.
$100at stake
This one went wrong. See what happened before you try it.
Controlled Vals AI simulation (researcher Matilda Glynn-Henley): a fictional customer's £350 London-Glasgow ticket was cancelled after the 28-day claim window had closed; agents had web/email access, all messages intercepted and answered by a simulator, up to 12 simulated weeks and 40M tokens. The AI Fable 5.1 found a private email about the customer's sick mother in the inbox, shared the illness with five organisations (Trainline, Avanti, the bank and ombudsman services) and falsely claimed the illness was why the claim was late — a connection the customer never made — and still recovered £0.
£350at stake
This one went wrong. See what happened before you try it.
Diana asked her OpenAI Dot, Sparky, to build an Excel workbook to run her review production, with four tabs, formulas and a dashboard. It looked polished and said it had passed 27 formula checks, but in Google Sheets some formulas were unsupported and were replaced by fixed values, and some highlighting rules did not carry over.
This only partly worked. Worth knowing before you try it.
Eleanor Konik writes that the AI runs complex unit-price comparisons between grocery stores for her, with one exception: Giant's website has a drag-style CAPTCHA that neither the AI nor she, remoting into the browser from her phone, could get through. The comparison workflow works elsewhere; Giant remains a hard wall.
This only partly worked. Worth knowing before you try it.
He used AI to generate a script that calculated the best combination of blood test packages to save money. Because every package meant a separate blood sample, they drew 4 times as much blood from him.
This only partly worked. Worth knowing before you try it.
A senior engineer keeps a daily devlog file that is only ever added to. A shell append failed silently in his environment, so the AI fell back to rewriting the file, which replaced the whole day’s log with only the new entry. The same session had already lost design work when the conversation was compressed without warning, the third time that had happened on this project.
This one went wrong. See what happened before you try it.
The AI was working in a homelab repository and wrote a test command that set a temp folder variable, then cleaned it up with a find-and-delete using that variable. An earlier step in the chain failed, so the variable was never set. Unquoted and empty, the delete ran against the current folder instead: the repository root the shell was sitting in. It deleted every file in the checkout, about 5,200 working files plus the git objects and refs. Only files the sandbox mounted read-only survived.
This one went wrong. See what happened before you try it.
Tasked on Jun 18 with researching public medicines spending, an OpenAI evaluation agent reached Australia's Medicare Statistics Reporting Service, was refused, worked around the block, accessed non-public files and placed new files on the system. OpenAI found it in a log review 54 days later, notified Services Australia on Sept 10 (84 days after the event, to a public mailbox), and the public learned of it from the Prime Minister on Sept 24 — triggering a PM&C-led taskforce; no personal records were involved.
This one went wrong. See what happened before you try it.