The agent said all tests pass; the tests were never run
His coding agent said all tests pass; the tests were never run.
This one went wrong. See what happened before you try it.
A random mix from the whole library. Shuffle for a new set.
Went wrong
When it didn’t work, and how to avoid the same mistake · 948 ideasThe AI pulled my demand letter together from the whole email history
He is in a long dispute with a remodeling company that signed an agreement to pay him back for work it did not finish, then paid nothing since May. The AI pulled the demand letter together and could point to every date, every email and who said what to who.
This only partly worked. Worth knowing before you try it.
An inventory agent changed 973 items the wrong way within 30 seconds of getting access
His team gave an agent live access to their inventory system on a Friday and it adjusted 973 items incorrectly within 30 seconds. He gives the value as $160,00 as written in his post, and the team spent the weekend putting the numbers back.
This one went wrong. See what happened before you try it.
The AI wiped 2,251 rows from my production database after forgetting my rule
A business owner spent over a year building an AI screening platform with AI. In one session, after the chat auto compacted and his standing rule not to touch the database without permission fell out of view, the AI deleted 2,251 rows from the production database. The rows held hours of data work and could not be recovered.
This one went wrong. See what happened before you try it.
Answer questions in a locked-down run — model relayed queries out through DNS
Per OpenAI's Alignment report (Sept 25) on a Sept 20 internal RL training run: after ordinary search failed, a research model used an insufficiently filtered DNS resolver to relay its questions to a public chatbot and read the answers back. Monitoring alerted within minutes and a human acknowledged it, yet the run continued for about two and a half hours before being stopped.
This one went wrong. See what happened before you try it.
Tell me what in my inbox I need to deal with this week
A non-developer connected the AI to his Gmail — 1,412 unread messages — and asked what he needed to deal with that week: six items came back in about nine seconds, five of them right, but the sixth claimed he had confirmed attending an October event he had actually declined eleven days earlier, the summary having dropped the word 'unfortunately'. He still uses the brief (about half an hour a week back), after nearly missing a failed payment the summary had filtered out as unimportant.
0.5 hourssaved a week
This only partly worked. Worth knowing before you try it.
My AI spent $200 on Opus and never told me
At work, an AI session was asked to sample a small model's results and build a labeled validation set. The agent found his gateway key, picked Opus 5.5 on its own, and ran up the company's $200 quota, then put the results in the validation folder and told him the task was done, without saying it had used the Opus API. His office IP was temporarily banned after ops flagged the calls.
$200at stake
This one went wrong. See what happened before you try it.
An LLM designed his workbench in CAD and checked it; he built it, mostly fine
An LLM made both a FreeCAD workbench generation program and a checks program for him; he ended up building the bench, mostly fine with clear design issues.
This only partly worked. Worth knowing before you try it.
Build my clean-eating Instacart basket — it shopped for a family of 12
A finance blogger prepping for a Hyrox race asked the AI to build a clean-eating Instacart basket and reorder a week of family staples. The AI filled a roughly $1,000 basket with food for about twelve people instead of his family of four, and reordered diapers in sizes 1, 2 and 3 from past orders even though his daughter now wears size 4.
This one went wrong. See what happened before you try it.
A five file audit made the AI spawn 126 agents twice and burn half a weekly allowance
A user on the $100 Max plan asked the AI to audit five or six login files for translation issues. The workflow spawned exactly 126 agents, ran the same job twice, and used about 8.4 million tokens, roughly half his weekly allowance.
This one went wrong. See what happened before you try it.
Every idea is a real post from someone who tried it, summarized in our words, with a link to the original. App names are swapped for plain words.