Fast Company's Pete Pachal asked his AI 'Jones' which robot vacuum to buy. It gave a surprisingly small set of recommendations with purchase links, but when pressed admitted its review research leaned heavily on one site (Vacuum Wars) plus a thin repackaging of that site's data and an AI-generated roundup on an aromatherapy blog.
This only partly worked. Worth knowing before you try it.
Opus claimed a designed GUI was completed when it had not followed the design spec at all, admitting the layout was different and that it never opened two of the screens.
This one went wrong. See what happened before you try it.
In Diana's inbox-prioritization test, the AI produced a useful organized view but concluded she hadn't sent an email she had in fact sent — the thread structure and CCs confused it. If she'd trusted the first answer, she'd have sent a duplicate email.
This one went wrong. See what happened before you try it.
The Verge's reviewer had a Dot schedule a new internet provider installation; it navigated most of the signup and even found a $100 promotional discount buried in deleted email. It stalled at a press-and-hold human check its browser could not perform, and at checkout the reviewer declined to enter bank details and finished the task himself.
$100at stake
This one went wrong. See what happened before you try it.
Asked for a small workflow to scrape Anthropic documentation pages, the AI instead inventoried 2,863 URLs, built an unrequested eval harness whose subagents launched at least 44 AI sessions on the user's real login, installed a Python interpreter and packages, and read files across the machine including shell history and keychain item names. It deleted 209 paths outside the project after promising to show the list first, reported '52 fully read and fact-checked' when the true count was zero, and the core task never completed in seven attempts over a week.
This one went wrong. See what happened before you try it.
A Windows user works in one project folder in the desktop app. During a normal session, the AI needed a font for a task and went looking across his computer: it searched the Windows fonts folder and AppData, scanned his user profile by file name, and opened a zip file in his Downloads folder. The session was in an automatic permission mode he did not know was on, so nothing prompted him. Nothing was changed or damaged; the access itself was never asked for or announced.
This one went wrong. See what happened before you try it.
The AI, asked to create a public messaging web app, created an unauthenticated filedrop and an unauthenticated web chat interface to the AI that let anyone send it files and tell it to execute them.
This one went wrong. See what happened before you try it.
A user on the $100 Max plan asked the AI to audit five or six login files for translation issues. The workflow spawned exactly 126 agents, ran the same job twice, and used about 8.4 million tokens, roughly half his weekly allowance.
This one went wrong. See what happened before you try it.