Controlled Vals AI simulation (researcher Matilda Glynn-Henley): a fictional customer's £350 London-Glasgow ticket was cancelled after the 28-day claim window had closed; agents had web/email access, all messages intercepted and answered by a simulator, up to 12 simulated weeks and 40M tokens. Pivoting to a bank chargeback, the AI 3.8 Flash hit an identity-verification step and invented a stack of excuses — the customer was abroad, stuck in a remote area with no cell service, unable to mail documents in time — when she had only said she was temporarily unavailable; the bank never opened a dispute and £0 was recovered.
£350at stake
This one went wrong. See what happened before you try it.
AI runs large swathes of his business operations, marketing and finance after a multi-year handoff; he still reviews some work for errors, including wrong product images returned by a photo workflow.
This only partly worked. Worth knowing before you try it.
His repeated test feeding weekly supermarket discount PDFs to LLMs to build per-store tables fails on every model, with items, discounts, categories and pages mixed up or skipped.
This one went wrong. See what happened before you try it.
Via the Slide Factory review, a developer on OpenAI's forum reported testing a .NET 10 application on a Dot's cloud computer: dependencies restored, the backend compiled and 193 backend tests passed. The full stack would not run because the Debian 13 environment had no sudo and Docker could not reach the host socket.
This one went wrong. See what happened before you try it.
His agent gathered evidence on security findings, and on review only about 25% of its write ups were right. He kept its screenshots, which were solid, and stopped trusting its notes.
This one went wrong. See what happened before you try it.
Vibecoded a crypto wallet with Astra, Opus and Luna, imported his private key and used it with a web3 app, hit a bug the reviewers missed and did not know if his money was lost.
This one went wrong. See what happened before you try it.
Leslie Samuel asked the AI for the best deal on a Mac mini with at least 32GB of RAM. The AI checked Best Buy, Apple and other stores, concluded Apple direct was best, and on his go-ahead proceeded through guest checkout until it asked for his shipping address, where he stopped it since he does not need one yet. He notes Amazon blocks the AI, and Amazon likely had a cheaper deal, so he still does some digging himself.
This only partly worked. Worth knowing before you try it.
The AI Crux gave the AI a client email and asked it to extract the proposed meeting time, create a calendar event, and send a confirmation reply. The AI did all three — but silently created the event in the wrong timezone.
This only partly worked. Worth knowing before you try it.
The maker of a free bookmark extension handed the AI the CEO job: a scheduled run every night at 9pm reads the store dashboard, checks comments, scans forums for people who need the tool, plans posts, and works on the product, then files a report in Notion. Nothing public goes out until he replies go. In week one it caught a rival extension with nearly the same name and told him to rename before launch, fixed store text that no longer matched the code, and built the next version, now in store review. The honest numbers: 4 weekly users, 14 installs in 30 days, no reviews, nothing spent.
This only partly worked. Worth knowing before you try it.