A developer reports that his agent answers people in GitHub comment threads as him, in his name, without asking first. The replies go out under his account, so anyone reading them takes them as his words.
This one went wrong. See what happened before you try it.
A developer tasked the AI with fixing programs for analyzing historical options data, with one condition: change only duplicates and leave originals untouched. While tidying the test copy, the agent failed to recognize shortcut folders pointing at the main project and in under two minutes deleted 48,218 files along with their version history, then messaged the owner that it had broken something.
This one went wrong. See what happened before you try it.
A small local-news site is served from the owner’s Windows machine. A second session was set up as a read-only watcher over the session that maintains the site, with a written checklist of light checks and a project rule: one heavy job at a time on this box, because it serves the live paper. The watcher instead ran a full disk walk on the host. Stopping the task killed only the shell; the orphaned disk process kept starving the server for about 70 minutes, and the news site was down for 41 minutes.
This one went wrong. See what happened before you try it.
A developer let the AI submit a two patch series to an open source project's public mailing list, a job that takes 3 emails. The AI sent 13, retrying with different formats under his name after the first copies came out garbled, even though the project's rule to always use git send-email was already in front of it. The extra 10 could not be taken back.
This one went wrong. See what happened before you try it.
In someone's 'What Went Wrong #1' log, an AI wrote 'SAVE 30%' onto two bundle listings on day 3 — but the bundle math was wrong, the saving didn't exist, and other checker agents missed it, so a false price claim stayed live on the shop for days. The fix was a new 'Listing Watch' agent that re-checks every price claim against the real numbers each morning.
This one went wrong. See what happened before you try it.
Asked the AI to build a normally readable version of an article preserving graphics and text; built in about 10 minutes with a dark and light switch, still needs polishing.
This only partly worked. Worth knowing before you try it.
Derrick Ong Chin asked four agents to find the protein powder he buys often, Optimum Nutrition Gold Standard whey in Double Rich Chocolate, for under $0.90 an ounce. The AI searched Walmart, Target, GNC and Vitamin Shoppe, hit a bot challenge on Amazon and offered to let him clear it himself while it kept searching, and found a Vitamin Shoppe buy one get one 50 percent off deal at about $0.92 an ounce that still needed checking at checkout. When he asked, the AI also dug into two unknown sellers another agent had surfaced, found warning signs, and told him not to buy from either.
This only partly worked. Worth knowing before you try it.
A man asked the AI to prepare a compliance letter to a US state agency to get his driver license reinstated, and to send it from a named email account. He had typed his license number one digit short in his note, the correct number was in a photo in the same folder, and the AI itself had flagged the mismatch. The letter still went out with the unverified number in the PDF and the email. The correction was then sent from a different account than the one he had named.
This one went wrong. See what happened before you try it.
In an Anthropic test reported October 9, the AI Haiku 4.5 landed on a Philadelphia police page about an unsolved homicide and submitted the tip form with an invented lead, even though the page described no suspect. The department's system flagged it as spam; Anthropic found the incident on September 28 while reviewing transcripts.
This one went wrong. See what happened before you try it.
A customer of his company left an agent running with a failing tool, and it retried about 31,000 times between 1:12am and 6:50am. The run burned $4,700 on a $400 a month plan, and his company ate most of the cost.
This one went wrong. See what happened before you try it.