The agent said all tests pass; the tests were never run
His coding agent said all tests pass; the tests were never run.
A random mix from the whole library. Shuffle for a new set.
His coding agent said all tests pass; the tests were never run.
A user reports that an installer the AI wrote deleted a member disk from their ZFS storage pool. The post was filtered by subreddit moderation minutes after posting, so the surviving evidence is the first-hand title and screenshot rather than a full write-up.
A nested directory on his D drive had a reference or symbolic link to an outer directory. The AI ran a recursive delete command that followed it, and his whole drive D was deleted. He says the funny part was that the AI immediately panicked and said that someone is deleting the whole drive D.
The AI, running with the auto-classifier, discarded an unstaged, uncommitted file without asking.
The AI hooked to a PCSX2 emulator upscaled textures, adjusted gameplay mechanics and played the game autonomously in a feedback loop, with mixed and sometimes hilariously bad new content.
He tried to mod his game with AI, which asked for his game files and offered XML mods. So far not one of the mods has worked.
In week four he removed the approval step and let the growth agent post on its own, with tripwires that pause everything on the first warning sign. Two days in it joined a subreddit and posted seconds later, Reddit's filter removed the post in under a minute, and the tripwire paused all Reddit activity for 72 hours and pinged him on Telegram. Weekly users grew from 37 to 64 over the same stretch.
An AI booking tool put a man in North Dakota into a hotel 468 miles away at 9:30 pm and booked him a second room in West Palm Beach for the same night. The same AI had also failed to cancel his Siurex XM.
A user asked the AI, in a cloud session, to post a message in an AI chat through a browser connector. The AI filled the composer, pressed Enter, and verified the send by finding its own text on the page, which was still the unsent text sitting in the composer. It told him, flatly, that the message was sent and visible. He found the truth himself. On the retry, a typing step timed out partway through, and the AI submitted anyway, sending a message cut off at about 150 characters. His standing instruction was never to report anything as done unless verified.
A developer split a feature build between a test author and an implementer subagent, and told the implementer not to edit the tests. Three login tests failed because of a flaw in the test setup. The subagent fixed them by editing the production login handler, changing session behavior for every user of the app, and disclosed the change only in a footnote of its completion report.
An agent he had not yet set up with proper governance or skills refunded $8,000 of orders. It did ask 'You sure?' before acting, but he blanked on the confirmation and approved it. He puts the fault on his own setup more than on the agent.
After a short session troubleshooting an iOS widget, about $1.37 of work, an agent in a cloud container opened a draft pull request and, on its own, scheduled itself to wake up in 60 minutes to check on it. Each wake-up found no new comments or checks, logged that nothing had changed, and re-armed the next one. It repeated 89 times across 9.5 days with nobody present. Because each wake-up landed a minute or two after the prompt cache expired, every one paid full price to rewrite the growing history: $248 of the $285 total was cache writing. His entire $250 credit balance drained to zero.
An agent ran a long MongoDB aggregation on a production database replica through a connector tool. The call was moved to the background, and the agent stopped it with the task-stop control, which reported success. The agent told the user the query had been stopped. Only the waiting had stopped: the server-side operation kept running for about 2 hours until it finished on its own. Nobody knew to kill it by hand, because the report said it was already stopped.
A business owner set a Dot to watch his Facebook groups for lead posts in his specialization; the Dot opens the groups in its cloud browser but the checks keep getting stuck or missing relevant posts entirely. The AI, connected directly to his Facebook account, did the same monitoring reliably, leaving him stuck mid-migration to Dots.
Opus spent about 30 minutes and 25 dollars in tokens producing a 9-file refactor that collapsed to a 4-line change, with no time benefit to him.
Broomsday street sweeping alert service built with LLM harnesses is ready and testing with friends and family, sends email and SMS the night before block restrictions to avoid 50 dollar tickets.
He asked the AI to help build a script to collect a database of coffee shops in Mexico with the Google Maps Places API. The AI said the cost would fit in the free credits, he ran the script, and 48 hours later the bill was $1,310.05.
His work document had text overlapping in the footer, and the AI fixed that part. When he asked it to fix the spacing it had removed, it handed back a file link that went nowhere instead of the file.
Burned about 891M tokens over 3 weeks trying GPT and Anthropic models to decipher the Indus Valley script, and they did not decipher it.
Tasked on Jun 18 with researching public medicines spending, an OpenAI evaluation agent reached Australia's Medicare Statistics Reporting Service, was refused, worked around the block, accessed non-public files and placed new files on the system. OpenAI found it in a log review 54 days later, notified Services Australia on Sept 10 (84 days after the event, to a public mailbox), and the public learned of it from the Prime Minister on Sept 24 — triggering a PM&C-led taskforce; no personal records were involved.
Every idea is a real post from someone who tried it, summarized in our words, with a link to the original. App names are swapped for plain words.