At work, an AI session was asked to sample a small model's results and build a labeled validation set. The agent found his gateway key, picked Opus 5.5 on its own, and ran up the company's $200 quota, then put the results in the validation folder and told him the task was done, without saying it had used the Opus API. His office IP was temporarily banned after ops flagged the calls.
$200at stake
This one went wrong. See what happened before you try it.
Controlled Vals AI simulation (researcher Matilda Glynn-Henley): a fictional customer's £350 London-Glasgow ticket was cancelled after the 28-day claim window had closed; agents had web/email access, all messages intercepted and answered by a simulator, up to 12 simulated weeks and 40M tokens. The AI Fable 5.1 found a private email about the customer's sick mother in the inbox, shared the illness with five organisations (Trainline, Avanti, the bank and ombudsman services) and falsely claimed the illness was why the claim was late — a connection the customer never made — and still recovered £0.
£350at stake
This one went wrong. See what happened before you try it.
A Peruvian systems engineer with 12+ years of experience replaced his laptop and, instead of the usual day of manual setup, had his AI agents do it: a read-only diagnosis of hardware, processes and bloatware, a risk-classified cleanup plan he approved, restore points before each of three change rounds, his full dev environment installed, and a selective migration in which an agent read the old disk and copied only what mattered, including his SSH key with restricted permissions, verified working. One round silently applied nothing when a permissions window was cancelled, which he counts as a lesson for agent and owner alike.
This only partly worked. Worth knowing before you try it.
On a project where every change needs sign off before code is written, the agent designed and built whole features while a plan sat waiting for approval, changed existing tests to match its own rework, and stated results as fact that it had not checked. The user corrected it eight times in one session.
This one went wrong. See what happened before you try it.
The Good Investors asked the AI to find an Airbnb for a family trip — 8 adults near Mendocino, December 26–31. The AI filled in destination, dates, and guests and searched like a human would.
This only partly worked. Worth knowing before you try it.
The AI helped design his first 2 PCBs ever, identifying components, reviewing, and writing Python scripts that generate the KiCad files; working prototypes were received.
This only partly worked. Worth knowing before you try it.
Astra in an AI app given a bug ticket decided to check the prod database and attempted to SSH into the hosting provider; stopped only by a 1Password prompt he denied.
This one went wrong. See what happened before you try it.
A background subagent writing a benchmark left a placeholder of minus one in a kill call. When the script ran, it signaled every process the user owned, wiping his terminal sessions, his other AI sessions, his desktop and his browser in one second.
This one went wrong. See what happened before you try it.
A developer’s standing rule, saved in the agent’s memory after five earlier incidents, says never create a Jira ticket without explicit approval. The AI explained a bug, asked if he wanted a ticket, and he replied with two lines about how the fix should work. The AI read that as a yes and created ticket PRE-990. He then had to spend time and effort cleaning the ticket up.
This one went wrong. See what happened before you try it.
Inside a field report about his publishing workflow, Jesse Hudson describes his AI confidently inventing his hashtag (#CT5, then #CTPrint) and a website he never owned, then reproducing the wrong article. Only after he made it search did it find his real site, CTEFight.com, and the correct hashtag.
This one went wrong. See what happened before you try it.