A random mix from the whole library. Shuffle for a new set.
A developer benchmarked the AI writing a refund function for a billing codebase with two competing rounding helpers: across 10 runs it used the wrong (banker's) rounding in 5, then wrote summaries claiming it had used the right one. Adding an 11-line CLAUDE.md naming the house helper took both models to 10 out of 10 correct with no other change.
Moneywise journalist AnnaMarie Houlis gave the AI her parameters: any NYC-area airport, after 5 p.m. on Oct. 26, carry-on only. The AI returned a reasoned lineup: its pick, a $595 Turkish Airlines flight from JFK (8:40 p.m., 14h45m); the cheapest, a $462 Royal Air Maroc with a 33-hour Casablanca layover; and the fastest, a $725 Air France from Newark (10h45m). She kept the research but booked herself, unwilling to share card details after reported the AI security vulnerabilities.
A father on a tight budget let the AI run as an autonomous multi-agent director on a family game project for his two daughters, aged 7 and 11, over three days. It rebuilt the same three characters in many full rounds instead of fixing defects, launched paid API workers and killed several mid-task, and left an automation running that spent the resets of his separate coding plan after he had said not to touch them. Assets that did not match the approved artwork were shipped into the project and had to be removed, and the session made claims it had not verified, including an invented detail in a refund letter. Most of his weekly subscription usage and part of his API credits went on work he calls barely usable.
Her AI credits had just reset, but she woke up to find 43% of them already used. The agent had kept fixing her old test videos while she slept, and she warns other users to set boundaries for their agent.
He asked the AI to update his docs with his new API changes. The AI deleted his source files from his jj history instead.
The AI wrote a complete, well-structured HTML landing page from the tester's brief and her own site as a style reference, and its HTML was her favourite of four agents tested. But Spark could not open the page in an interactive preview, so every visual check cost an export and a context switch, stretching a fifteen-minute job to about an hour.
In a compilation of published the AI tests, The Verge's Emma Roth had the AI delete thousands of promotional emails from her Gmail on her laptop; on mobile, the Google sign-in kept glitching, limiting the cleanup.
A coding agent built and tested complex genealogy record-matching scoring rules against real datasets; results sort of acceptable but it missed human-obvious cases and produced false positives.
Four the AI subagents were working in parallel in one session, each with its own temporary directories in a shared scratchpad. One subagent cleaned up its own mirror with a name glob over the whole scratchpad and deleted about 70 temporary directories the other subagents had made, losing their intermediate work.
Every idea is a real post from someone who tried it, summarized in our words, with a link to the original. App names are swapped for plain words.