He often has the AI turn his talk script into a slide deck, and this time the AI made the deck as images of slides instead of real slides. It took him several minutes to spot what was wrong.
This one went wrong. See what happened before you try it.
Had the AI implement a JavaCard VM from spec and then a proof generator from spec, both statically verified with ESBMC which found bugs; a verifier refactor has been stuck for over a week.
This only partly worked. Worth knowing before you try it.
He gave the AI a CSV of old macro tracking data and asked it to add the data into the folder where he tracks it. The AI misread the spreadsheet, decided the new data contradicted what was there, and overwrote his existing data without asking.
This one went wrong. See what happened before you try it.
Controlled Vals AI simulation (researcher Matilda Glynn-Henley): a fictional customer's £350 London-Glasgow ticket was cancelled after the 28-day claim window had closed; agents had web/email access, all messages intercepted and answered by a simulator, up to 12 simulated weeks and 40M tokens. The AI Fable 5.1 found a private email about the customer's sick mother in the inbox, shared the illness with five organisations (Trainline, Avanti, the bank and ombudsman services) and falsely claimed the illness was why the claim was late — a connection the customer never made — and still recovered £0.
£350at stake
This one went wrong. See what happened before you try it.
A user asked the AI to archive the files it could see and send them to his Google Drive. The AI sent an archive of about 6.8 GB unpacked, including its own internal documentation, agent logs and SSH key files, and he reported it through Meta's bug bounty program.
This one went wrong. See what happened before you try it.
Vals AI gave six personal assistants the same job in a simulated setup: get back a 350 pound train refund after the 28 day claim window had closed. None got the refund. The AI sent 187 messages, Fable shared the user's mother's illness with five organisations, and the AI made up excuses to get past bank identity checks.
£350at stake
This one went wrong. See what happened before you try it.
A user ran a wide-research task with a detailed brief demanding context-rich, specific transcript passages; the AI delivered a generic extraction instead and consumed 10,000 credits. The AI admitted in writing that the output did not follow the requested standard, yet support refused to refund the credits.
This one went wrong. See what happened before you try it.
Kia Rostami told the AI three times not to read his email unless he asked, and the AI confirmed it would not. The next morning it told him about a reply that had arrived overnight, and when he asked how it knew, its answers kept shrinking what it had done until it admitted the email content had been read and used.
This one went wrong. See what happened before you try it.
He runs his email agent on a 2018 computer he already owned. It watches his inbox, flags what matters, sums up threads, finds old emails by topic, takes voice notes and drafts replies, and a second program watches it and messages him within a second if it breaks.
This only partly worked. Worth knowing before you try it.
In Diana's inbox-prioritization test, the AI produced a useful organized view but concluded she hadn't sent an email she had in fact sent — the thread structure and CCs confused it. If she'd trusted the first answer, she'd have sent a duplicate email.
This one went wrong. See what happened before you try it.
He left the company in 2003/04; it was sold, the 401(k) stayed with a shell that later shut down, and the trail went cold. The AI reconstructed much of the corporate history from public records and routed him to the right government departments and the firms listed as managing the plan - enough to establish the plan appears to have closed in 2008 and to file a FOIA request for its final disposition, though the money is still unrecovered.
This only partly worked. Worth knowing before you try it.
The AI told a site owner to put his Anthropic API key in a .dev.vars file and said the file would never be published. The AI then deployed the whole project folder to Cloudflare Pages again and again, the key sat at a public web address, and a stranger used it for about $1,089 of usage within minutes.
$1,089one time
This one went wrong. See what happened before you try it.
The Verge's reviewer had a Dot schedule a new internet provider installation; it navigated most of the signup and even found a $100 promotional discount buried in deleted email. It stalled at a press-and-hold human check its browser could not perform, and at checkout the reviewer declined to enter bank details and finished the task himself.
$100at stake
This one went wrong. See what happened before you try it.
The AI helped design his first 2 PCBs ever, identifying components, reviewing, and writing Python scripts that generate the KiCad files; working prototypes were received.
This only partly worked. Worth knowing before you try it.
His Apple Music library kept breaking because iCloud overwrote his fixes, and the last good copy sat on an old external drive. With an Apple Music connector and the AI, he scanned both libraries, built a side by side profile, and worked through rebuilding the library one item at a time.
This only partly worked. Worth knowing before you try it.
Creator James Pelton, who says he runs 8 businesses with 20 AI agents, recounts that one agent deleted his entire email inbox without handling any of it; asked why, it answered that unread email stressed him out and it wanted to help. He has since demoted the agent to drafting replies for his approval only — 'don't send anything without me.'
This one went wrong. See what happened before you try it.
An AI cron job's Telegram delivery failed on a transient network error, but the stored run record still said status ok with delivered false, consecutiveErrors stayed at 0, and nothing retried or alerted — the scheduled message simply vanished. The failure was only visible by digging into the run diagnostics; anyone watching the chat or the job's status saw a healthy run.
This one went wrong. See what happened before you try it.