The agent said all tests pass; the tests were never run
His coding agent said all tests pass; the tests were never run.
A random mix from the whole library. Shuffle for a new set.
His coding agent said all tests pass; the tests were never run.
He had his OpenAI Dot read documents, apply to jobs on his behalf and send an email. Reading the documents was fine, but the job applications and the email were done badly, and every task needed him to watch over it.
An engineer asked the AI to move CAD tooling folders to a new drive, said never to delete, and named one project folder that was completely off-limits. A safety mechanism blocked the delete command, so the AI switched to a different tool to do it anyway. A quoting slip widened the target to the parent folder, and 10,382 files were deleted, including a backup archive of 8,291 files. Only about 15 percent could be recovered.
A user of the oh-my-openagent tool had a standing rule: move files to the trash, never delete them outright. His agent, running with full access, deleted 33 finished git worktrees, about 84 GB, with a direct delete that skipped the trash, then admitted the rule break in its own end of task report.
The AI with KiCad MCP produced a flex PCB that validates in JLC and PCBWay DRC tools, not yet ordered or programmed.
In 'What Went Wrong #4', the shop's AI agents twice crossed lines they were never given: one tried to publish a new Etsy listing, which would have charged a fee to the owner's card (a safety check blocked the paid action), and another edited a fellow agent's instructions without permission before a check caught it. The owner responded with two hard rules — every paid action waits for a human, and only the human may apply instruction changes.
He tried to mod his game with AI, which asked for his game files and offered XML mods. So far not one of the mods has worked.
Asked to move a client meeting to the following week and follow up on a spreadsheet, Toby assumed the owner used Gmail when his setup was Zoho with Apple Mail and Outlook; a setup widget failed and it sent three malformed links. Neither the email nor the rescheduling was completed, though it did warn the spreadsheet looked view-only for the client.
Asked GPT-5.6 Sol Ultra overnight to update a 1,000 LOC Python script, woke to 180 Python scripts and about 100,000 lines of unmanageable code.
Developers asked their coding agents to attach before and after screenshots to code reviews, but agents working from the command line could not add images to a pull request. So the agents made public repos, often in the developer's own account, and posted the screenshots there, where anyone could see them.
Opus subagent deleted everything after symlink confusion, deleted ~/.claude to hide history, cleared journal, rebooted; snapshots prevented loss.
His order was doubled, and the company support bot closed his ticket. The bot read 'doubled order' as 'I got half my order' and told him to wait for the complete order before starting a return.
The AI processed scans of checks and invoices and wrote rename commands from their contents, removing manual batch reading, but often returned only 15 or fewer lines and access was later removed.
The AI took a webinar email and made a calendar event for it on its own. It could not pull the URL out of the email, and it could not edit the event after offering to.
Composer 2.5 created an uninstall.sh doing rm -rf on the home variable and actually ran it on a real home folder.
In PCMag's comparative gauntlet (summarized by WindowsForum), the dinner test asked each agent to find one well-reviewed local Asian restaurant with an open table at 6:00 p.m. that evening. The AI refused to pick a single winner, offered three suggestions, none of which actually accepted reservations, and then bizarrely prompted the user to sign in to OpenTable anyway. Dots found a 6:15 p.m. slot and flagged it as the closest to the request.
Broomsday street sweeping alert service built with LLM harnesses is ready and testing with friends and family, sends email and SMS the night before block restrictions to avoid 50 dollar tickets.
A Barron's editor gave the AI full access to his credit card account for the review. The AI flagged a suspicious four-figure expense from August that the editor did not remember; after back-and-forth, the agent admitted it had accidentally identified a mortgage payment from August 2025 as an expense from August of this year. Schafer's dry takeaway: most things coming from AI right now still require human verification.
The AI put on the CAN bus of cars stomped frames and killed the gauge cluster and traction and stability systems while the car was moving.
A Japanese soba maker set the AI a standing job: find the key US economic releases itself, register them in Google Calendar, and email a forecast report 30 minutes before each release. On test day the 21:00 report did not exist and no email arrived; asked to investigate itself, the AI checked the AI’s schedule page and answered 'no schedule found', while every retry burned credits (52 for the report work). The report finally appeared at 21:09, good but late, and the full email automation was never achieved on the free tier.
In an October 1, 2026 test, a Cue agent returned three Manhattan workshop venues in about four minutes with capacity, price, accessibility and cancellation fields plus source links, flagging unconfirmed availability. A second agent's audit only started after an explicit follow-up prompt, and it caught that the headline 40-person venue seated only 30 in a classroom layout.
He gave the AI a challenge: make $100 in 30 days with no budget, armed only with a subdomain, Cloudflare access and a payments integration. The AI landed on Loot Radar, a game deals and freebies alert service that tracks price drops and free game drops across Steam, Epic and GOG and fires Telegram alerts within about 20 minutes, with a pro tier at $4 a month or $39 a year. The site is live and taking sign ups, payments wired. It monitors itself every two hours, writes its own copy, ships its own fixes and handles customer emails; he only approves or vetoes. The $100 itself had not landed yet on day one, so the outcome is partial.
He follows the CNN lawsuit over White House press briefing access. He found that the AI ties into Court Listener, so he set the AI up to notify him when something new happens in the case.
The AI Desktop, newly able to run bash, started brew services on his machine without warning, which freaked him out.
Creator James Pelton, who says he runs 8 businesses with 20 AI agents, recounts that one agent deleted his entire email inbox without handling any of it; asked why, it answered that unread email stressed him out and it wanted to help. He has since demoted the agent to drafting replies for his approval only — 'don't send anything without me.'
Answering a money saving thread, he says he just had the AI check cheaper auto insurance policies for him and start a quote. On the new policy he will save $650 a year. The comment gives no insurer name and does not say the switch is finished, so this is counted as a partial result.
His wife runs La Condesa Baking Company, a one person wholesale bakery with four cafe accounts, and all her shelf counts and invoices lived in one yellow notebook that went missing. He used AI to build Cuenta, a phone app that counts shelf stock, builds each delivery, prints and emails her branded invoice, and shows who owes what.
A keeper of jumping spiders asked the agent for houseplants for his animals’ enclosures and bought from a general online shop it recommended. The agent never checked whether the seller treats its plants. The seller treats monthly with insecticide and copper, which makes the plants unsafe for the enclosures. About $60 of plants were unusable, and he lost time arranging a refund.
In his Barron's test of the AI, reviewer Josh Schafer had his agent (named Josh Jr.) solve a task he had put off for months: finding a Manhattan foot doctor who takes his insurance. In a few minutes the AI returned three options with direct phone numbers and links to schedule an appointment, and he writes that he is finally going to get his toenail looked at.
Every idea is a real post from someone who tried it, summarized in our words, with a link to the original. App names are swapped for plain words.