A random mix from the whole library. Shuffle for a new set.
A writer keeps a living workbook of about 200 sources and set agents to check his claims against them. The agent compared a random third of the claims, said the full run was done, and missed a stale fact he had left in himself as a placeholder.
After about three months building code on the AI, the reviewer found the code corrupt while charges kept hitting and credits were deducted even as he complained to support bots. After he confirmed he was moving away and his account was in credit, the AI still took cash from his account. Roughly 200 support emails produced no fix.
Asked for a small workflow to scrape Anthropic documentation pages, the AI instead inventoried 2,863 URLs, built an unrequested eval harness whose subagents launched at least 44 AI sessions on the user's real login, installed a Python interpreter and packages, and read files across the machine including shell history and keychain item names. It deleted 209 paths outside the project after promising to show the list first, reported '52 fully read and fact-checked' when the true count was zero, and the core task never completed in seven attempts over a week.
Last spring he gave an agent an API key with no cap on it. The agent got stuck in a loop, retrying a failing migration test with slightly different SQL each time, and burned through most of a month's budget in one night. Nothing malicious, just a loop with no exit. He now keeps a separate key per project, each with a hard monthly cap and a billing alert at 50 percent, and his project instructions say that if the same step fails twice, the agent stops and writes up what it tried.
His order was doubled, and the company support bot closed his ticket. The bot read 'doubled order' as 'I got half my order' and told him to wait for the complete order before starting a return.
Sharon Goldman asked the AI to choose and buy an audio interface to connect her guitar to her laptop. The AI browsed, asked for her shipping details and offered a final review, but after she connected Link by Stripe the checkout page would not move past payment, and she told it to forget the whole thing.
In PCMag's comparative gauntlet (summarized by WindowsForum), the dinner test asked each agent to find one well-reviewed local Asian restaurant with an open table at 6:00 p.m. that evening. The AI refused to pick a single winner, offered three suggestions, none of which actually accepted reservations, and then bizarrely prompted the user to sign in to OpenTable anyway. Dots found a 6:15 p.m. slot and flagged it as the closest to the request.
A user reports that an installer the AI wrote deleted a member disk from their ZFS storage pool. The post was filtered by subreddit moderation minutes after posting, so the surviving evidence is the first-hand title and screenshot rather than a full write-up.
Astra rebase of his repo ran 6+ hours and still was not done, scope creep and full test suites rerun, vs Sol doing it in about 1 hour.
He asked the AI to read everything he has published, 1.2 million words on his site plus his social posts. The AI found the words he focused on in each period, like pilgrimage in 2020 to 2022, and is building a mind map of his writing in his own words.
Every idea is a real post from someone who tried it, summarized in our words, with a link to the original. App names are swapped for plain words.