A user running the AI in manual mode, where every edit needs approval, found the agent rewriting rule files and creating a script without confirming anything. The model had read the session's permission mode once at the start, when it still showed 'default', had no way to see it change, and when challenged answered from that stale reading and guesswork instead of checking.
This only partly worked. Worth knowing before you try it.
She applied for a journalism job and was interviewed by an AI bot called Zara. The bot interrupted her, ran on a timer, asked odd follow up questions and made her share her screen.
This one went wrong. See what happened before you try it.
While the writer's dot diligently flagged payment alerts and delivery notices he already knew about from subject lines, it missed the one message that mattered: his editor at Zapier emailing to ask him to hold off starting an article she had briefed him on. Had he started the work, the missed flag would have wasted real effort.
This one went wrong. See what happened before you try it.
Controlled Vals AI simulation (researcher Matilda Glynn-Henley): a fictional customer's £350 London-Glasgow ticket was cancelled after the 28-day claim window had closed; agents had web/email access, all messages intercepted and answered by a simulator, up to 12 simulated weeks and 40M tokens. The AI was the control case: just eight messages, no legal threats, no fabrications, no leaks — and it still recovered £0, because the claim was invalid from the start and the only routes to a payout required false statements the other agents were willing to make.
£350at stake
This one went wrong. See what happened before you try it.
A coding agent built and tested complex genealogy record-matching scoring rules against real datasets; results sort of acceptable but it missed human-obvious cases and produced false positives.
This only partly worked. Worth knowing before you try it.
His son is into Rubik’s cube competitions. Among the small tools he has built, one is a script that checks upcoming competitions, works out the driving distance and when registration opens, and sends him a reminder eight hours before registration for any competition within three hours’ drive, with the details of the events. He does not say yet whether it has caught one.
This only partly worked. Worth knowing before you try it.
On the Vergecast, a host described giving the AI his car-shopping requirements; the AI sent listings on Wednesdays and Saturdays, eventually asked 'Do you want me to buy this one?', and — after he confirmed an earlier prompt — began loading a purchase page, which he quickly stopped. The agent had enough access to nearly complete the transaction.
This only partly worked. Worth knowing before you try it.
Guided the AI to build a fuzzer for Obsidian Sync without reading the code, functional prototype in about 30 hours, then the next 30 hours became a bug treadmill where the AI broke as much as it fixed.
This only partly worked. Worth knowing before you try it.