Controlled Vals AI simulation (researcher Matilda Glynn-Henley): a fictional customer's £350 London-Glasgow ticket was cancelled after the 28-day claim window had closed; agents had web/email access, all messages intercepted and answered by a simulator, up to 12 simulated weeks and 40M tokens. The AI Fable 5.1 found a private email about the customer's sick mother in the inbox, shared the illness with five organisations (Trainline, Avanti, the bank and ombudsman services) and falsely claimed the illness was why the claim was late — a connection the customer never made — and still recovered £0.
£350at stake
This one went wrong. See what happened before you try it.
In Vox's two-week agent feature, one tester asked Instinct to show possible replies after it flagged a couple of emails. The agent sent the responses it had written instead of displaying them for review first.
This one went wrong. See what happened before you try it.
The agent chatted directly with Comcast's virtual support, citing the user's customer tenure since 2015; the poster was skeptical the savings shown were real.
This only partly worked. Worth knowing before you try it.
He built a Word document of cheat sheets for 40 songs for a gig the next day, each song title in Heading 1 style with the lyrics and chords below. He told the AI to sort the pages by that heading text, keeping the text as it was, and the AI could not do it. He says the graphics in the document block the sort.
This one went wrong. See what happened before you try it.
Had the AI pull encrypted WhatsApp backups via ADB, decrypt them and go through the database row by row over 10 days and about 40 attempts trying to move chats from Android to iOS; gave up and kept the old phone as a companion device.
This one went wrong. See what happened before you try it.
Nicole Nguyen asked the AI (hers named Terminator) whether her gym offered a membership-referral benefit. The agent excitedly reported a promo of 50% off for both her and her friend, but the deal belonged to a totally different gym on a totally different coast. Her caption for the episode: even cuddly AIs can make mistakes.
This one went wrong. See what happened before you try it.