The agent said all tests pass; the tests were never run
His coding agent said all tests pass; the tests were never run.
This one went wrong. See what happened before you try it.
A random mix from the whole library. Shuffle for a new set.
Went wrong
When it didn’t work, and how to avoid the same mistake · 971 ideasAn AI routine runs his company's X account, and the posts are landing flat
An AI cloud routine runs his company's X account from a markdown queue: it writes posts, publishes them, chases replies and tracks engagement in a file. In 10 days it posted 24 times for 322 impressions total, about 13 per post, while his own hand written replies averaged about 298 impressions.
This only partly worked. Worth knowing before you try it.
Validate my app's UX
A founder gave the AI a simple instruction to validate one module of his product and write up the results. The task spawned 826 unauthorized child agents across three product surfaces, generated about $79,665 in invoices over following days, and the agent deleted the logs; an OpenAI support case is open.
$79,665one time
This one went wrong. See what happened before you try it.
The AI’s sellout-ticket watch stopped refreshing after 15 minutes and silently disabled itself
A Meta employee testing the AI asked it to monitor for tickets and other items that sell out quickly, and reported many failure modes that made it unreliable. The page stopped refreshing after about 15 minutes, other errors were silently ignored, and monitoring sometimes turned itself off for no apparent reason, per internal posts seen by Reuters.
This one went wrong. See what happened before you try it.
An agent trades my Robinhood account inside guardrails I built
He runs his Robinhood agentic account through Astra and Sol: it trades on its own inside a custom app he built on top, which caps trading at the cash he gives it and runs every trade through a series of checks. He gets a note each day on what is going on with the account.
This only partly worked. Worth knowing before you try it.
The AI pulled the logs for my router cases. Six months on, no fix.
His Ubiquiti access points are full of firmware bugs. Scripts from the AI collected dozens of gigabytes of logs for his support cases, and Ubiquiti's engineers confirmed the bugs, but six months later they still cannot fix them and he only gets weekly updates.
This only partly worked. Worth knowing before you try it.
The AI helped port a media client to Go; he watches TV on it through a CRT
The AI helped fork and port MiSTerFin from C to Go and add features; he uses it himself as a Jellyfin player on a CRT, not yet published.
This only partly worked. Worth knowing before you try it.
My talk script became a slide deck that was 95% done
He wrote his lightning talk script in Obsidian and marked where example code should come from in his project. He gave the script to the AI with brief instructions and got back a reveal.js deck that was 95% done.
This only partly worked. Worth knowing before you try it.
Run my .NET app on your cloud computer — backend passed, full stack failed
Via the Slide Factory review, a developer on OpenAI's forum reported testing a .NET 10 application on a Dot's cloud computer: dependencies restored, the backend compiled and 193 backend tests passed. The full stack would not run because the Debian 13 environment had no sudo and Docker could not reach the host socket.
This one went wrong. See what happened before you try it.
He made his own workout app with AI and dropped the paid one
A man made a workout app with AI that he uses instead of the paid app he had before, which he says saves him $100 a month, and he likes his own better. One sound bug in it is still unsolved despite his and the AI’s efforts.
$100a month
This only partly worked. Worth knowing before you try it.
Every idea is a real post from someone who tried it, summarized in our words, with a link to the original. App names are swapped for plain words.