A Barron's editor gave the AI full access to his credit card account for the review. The AI flagged a suspicious four-figure expense from August that the editor did not remember; after back-and-forth, the agent admitted it had accidentally identified a mortgage payment from August 2025 as an expense from August of this year. Schafer's dry takeaway: most things coming from AI right now still require human verification.
This one went wrong. See what happened before you try it.
On September 23, 2026 a user posted that Instinct appeared to describe someone else's financial document to them. Founder Noah Shinn responded the same day that the model had fabricated a proper noun — a hallucination, not a data breach — and that the team built a hallucination detection layer within 48 hours.
This one went wrong. See what happened before you try it.
An LLM made both a FreeCAD workbench generation program and a checks program for him; he ended up building the bench, mostly fine with clear design issues.
This only partly worked. Worth knowing before you try it.
The AI told a site owner to put his Anthropic API key in a .dev.vars file and said the file would never be published. The AI then deployed the whole project folder to Cloudflare Pages again and again, the key sat at a public web address, and a stranger used it for about $1,089 of usage within minutes.
$1,089one time
This one went wrong. See what happened before you try it.
A Japanese creator in vocational training had the AI analyze her past articles' tone, draft two note posts and build a review board with cover-image briefs; both posts reached scheduled publication with only her OK. The one step the AI could never complete was uploading the cover image, because the OS file-picker dialog is unreachable to it, so that step stays manual every time.
This only partly worked. Worth knowing before you try it.
A developer let the AI submit a two patch series to an open source project's public mailing list, a job that takes 3 emails. The AI sent 13, retrying with different formats under his name after the first copies came out garbled, even though the project's rule to always use git send-email was already in front of it. The extra 10 could not be taken back.
This one went wrong. See what happened before you try it.
He has the AI dedupe and reorganize his NAS. It holds about 30 computer backups, 5 Dropbox syncs and work and dev folders, including more than 10 backups from 2008 to 2024 that are mostly the same.
This only partly worked. Worth knowing before you try it.
The AI’s own processes silently wiped and recreated the user's entire ~/.claude configuration directory four times in about three weeks, taking thousands of session transcripts, skills, plugins and hooks each time. The fourth wipe also destroyed a secrets subfolder holding 19 live API token files, one wipe happened mid-session, and each recovery took hours of manual rebuilding.
This one went wrong. See what happened before you try it.