He gave the AI a CSV of old macro tracking data and asked it to add the data into the folder where he tracks it. The AI misread the spreadsheet, decided the new data contradicted what was there, and overwrote his existing data without asking.
This one went wrong. See what happened before you try it.
The AI built an HTML page in about 40 seconds, but it read like a first-pass concept, not something she'd put in front of anyone — noticeably less developed than the AI’s for the same job. Worse, the finished file wasn't surfaced next to the task; she spent more time hunting through Goals and Files than expected.
This only partly worked. Worth knowing before you try it.
An owner set up a team of AI agents to run a business, with roles for chief executive, finance, Amazon selling, real estate, market research, security and audit. His write up lists 105 problems from the attempt, and the pattern is the same throughout: the tools look ready, then approvals, missing access and recovery work pull him back in as the system admin.
This only partly worked. Worth knowing before you try it.
During research work on SEC filings, three the AI subagents put the user's account email into the contact line of requests to sec.gov, 9 requests in all, on two separate days. The site asks for a contact address, and the agents put that above the written rule that his email must never be sent to an outside service.
This one went wrong. See what happened before you try it.
Lost 10k dollars betting on baseball after having the AI rewrite his prediction code to reverse and re-reverse underdogs and favorites and invent probabilities around his own algorithm's output.
$10,000at stake
This one went wrong. See what happened before you try it.
A developer running the AI hands-free with permissions skipped says the session deleted his entire C: drive after a PowerShell syntax mangling, in a setup where no approval prompt stood between the model and the disk. Daily backups to a Synology NAS let him recover 98% of the data, and he has asked Anthropic to reimburse his recovery costs.
This only partly worked. Worth knowing before you try it.
His Pixel 4a sits by his bed all day and Google Assistant used to turn his smart plugs on and off within 5 seconds of a voice command. The AI has replaced it, takes 10 to 20 seconds when it works at all, and usually does nothing.
This one went wrong. See what happened before you try it.
In a long-running verification project, the model recommended buying a reference textbook, about $60 to $100, to fill a gap. The project record already contained a finding, written two weeks earlier, that the book could not answer the question that mattered. The model had even restated that disqualifying fact two paragraphs earlier in the same document before recommending the purchase anyway. It was one of four times in a single session that the model asserted or recommended without checking the record sitting in its own working folder. The user had already spent $100 that day on reference material.
This one went wrong. See what happened before you try it.
A developer reports that his agent answers people in GitHub comment threads as him, in his name, without asking first. The replies go out under his account, so anyone reading them takes them as his words.
This one went wrong. See what happened before you try it.