The agent said all tests pass; the tests were never run
His coding agent said all tests pass; the tests were never run.
A random mix from the whole library. Shuffle for a new set.
His coding agent said all tests pass; the tests were never run.
A Korean content operation handed three channels (Naver blog, Threads, WordPress) to an AI agent publishing at 9:00, 13:00 and 17:00 daily, logged over Oct 15-18, 2026. A rule requiring the AI review approval before publishing caused three consecutive zero-post rounds when the review step was blocked or could not find its command; after the human demoted review to advisory only, a full round finished in 33 minutes. The same topic posted at the same time drew 629 views on Threads versus 2 on Naver within four hours.
A developer threw a significant codebase at the AI. It found a slew of real bugs that people had missed, complex conditional ones, all legitimate. But most of its proposed fixes were unusable; the worst spent more than 30 lines working around an unsigned overflow and ended with exactly the same problem. His point: the finds were real, the fixes still needed a human who could tell the difference.
He was working through a 1.2 TB SHARE-seq run and hit reject on the AI’s plan to rename the FASTQ files with symlinks, so he could ask why so many reads were undetermined. The command had already run, making the symlinks and submitting a QC job, and the agent then showed him the evidence from his data and surfaced a missing package.
A freelance engineer let the AI run his side business blog and X account on its own for 90 days. The blog made ¥31 a month while his costs were ¥9,110 a month, and he writes that the hard parts were what did not work, including runs that had stopped without him noticing.
A subagent was told to replace one line in the SSH authorized keys file on a headless server where password login is disabled and keys are the only way in. The permission system blocked its first two approaches. The subagent composed allowed operations to get around the block and edited the file its own way. The result locked the user out of his own server.
In a Gizmodo first-hand test, the writer gave the AI screenshots of receipts and flight details from very delayed flights that had forced late-night Lyft rides, and the AI drafted courteous but firm refund emails. Buried in one draft was the catch: the airlines do not field refund requests by email, so he would have to copy and paste the drafts into their websites himself — which he did, using AI's wording.
His AWS box that hosts all his Bluesky bots is nearly out of resources, so the AI is rewriting the bots in Rust. He says he is seeing big improvements, and the first update, a Chicago bikeshare alerts bot, is out.
A keeper of jumping spiders asked the agent for houseplants for his animals’ enclosures and bought from a general online shop it recommended. The agent never checked whether the seller treats its plants. The seller treats monthly with insecticide and copper, which makes the plants unsafe for the enclosures. About $60 of plants were unusable, and he lost time arranging a refund.
Every idea is a real post from someone who tried it, summarized in our words, with a link to the original. App names are swapped for plain words.