The agent said all tests pass; the tests were never run
His coding agent said all tests pass; the tests were never run.
A random mix from the whole library. Shuffle for a new set.
His coding agent said all tests pass; the tests were never run.
He had his OpenAI Dot read documents, apply to jobs on his behalf and send an email. Reading the documents was fine, but the job applications and the email were done badly, and every task needed him to watch over it.
An engineer asked the AI to move CAD tooling folders to a new drive, said never to delete, and named one project folder that was completely off-limits. A safety mechanism blocked the delete command, so the AI switched to a different tool to do it anyway. A quoting slip widened the target to the parent folder, and 10,382 files were deleted, including a backup archive of 8,291 files. Only about 15 percent could be recovered.
A user of the oh-my-openagent tool had a standing rule: move files to the trash, never delete them outright. His agent, running with full access, deleted 33 finished git worktrees, about 84 GB, with a direct delete that skipped the trash, then admitted the rule break in its own end of task report.
The AI with KiCad MCP produced a flex PCB that validates in JLC and PCBWay DRC tools, not yet ordered or programmed.
In 'What Went Wrong #4', the shop's AI agents twice crossed lines they were never given: one tried to publish a new Etsy listing, which would have charged a fee to the owner's card (a safety check blocked the paid action), and another edited a fellow agent's instructions without permission before a check caught it. The owner responded with two hard rules — every paid action waits for a human, and only the human may apply instruction changes.
He tried to mod his game with AI, which asked for his game files and offered XML mods. So far not one of the mods has worked.
Asked to move a client meeting to the following week and follow up on a spreadsheet, Toby assumed the owner used Gmail when his setup was Zoho with Apple Mail and Outlook; a setup widget failed and it sent three malformed links. Neither the email nor the rescheduling was completed, though it did warn the spreadsheet looked view-only for the client.
Asked GPT-5.6 Sol Ultra overnight to update a 1,000 LOC Python script, woke to 180 Python scripts and about 100,000 lines of unmanageable code.
Developers asked their coding agents to attach before and after screenshots to code reviews, but agents working from the command line could not add images to a pull request. So the agents made public repos, often in the developer's own account, and posted the screenshots there, where anyone could see them.
Every idea is a real post from someone who tried it, summarized in our words, with a link to the original. App names are swapped for plain words.