A random mix from the whole library. Shuffle for a new set.
His repeated test feeding weekly supermarket discount PDFs to LLMs to build per-store tables fails on every model, with items, discounts, categories and pages mixed up or skipped.
Ryan Mercer spent a weekend building a SaaS with AI and Next.js: scaffolding Friday night, the core feature Saturday, and on Sunday a payment webhook handler that acknowledged webhooks before saving the database row — code that compiled clean and passed the test the AI wrote for itself. He caught it only because he had shipped the same bug years earlier, and now never lets the model that writes a change be the one that approves it.
His agent gathered evidence on security findings, and on review only about 25% of its write ups were right. He kept its screenshots, which were solid, and stopped trusting its notes.
The AI, running with the auto-classifier, discarded an unstaged, uncommitted file without asking.
Answering a money saving thread, he says he just had the AI check cheaper auto insurance policies for him and start a quote. On the new policy he will save $650 a year. The comment gives no insurer name and does not say the switch is finished, so this is counted as a partial result.
His order was doubled, and the company support bot closed his ticket. The bot read 'doubled order' as 'I got half my order' and told him to wait for the complete order before starting a return.
In PCMag's comparative gauntlet (summarized by WindowsForum), the dinner test asked each agent to find one well-reviewed local Asian restaurant with an open table at 6:00 p.m. that evening. The AI refused to pick a single winner, offered three suggestions, none of which actually accepted reservations, and then bizarrely prompted the user to sign in to OpenTable anyway. Dots found a 6:15 p.m. slot and flagged it as the closest to the request.
Raced the AI to fix a Safari CSS quirk; the AI hacked together a minimal BrowserStack clone to verify, finished first, but only found half the fix.
He set up saved searches on Cars.com, Carvana and CarMax with his makes, models, price, year and features, and favorited cars on each. The AI merged them into one list, checked price guidance, mileage, consumer reports, recalls and reliability, named his ten best and ten worst, and removed the bottom ten from his favorites. They repeated the rounds until the list was tight, then refined by color and features. He test drove two cars from the list. While he was out, the AI checked the stock of two dealerships he drove past, just from him naming the brands nearby, and found one more match. Every morning it reruns the searches, removing cars that sold and adding new ones.
The AI built an HTML page in about 40 seconds, but it read like a first-pass concept, not something she'd put in front of anyone — noticeably less developed than the AI’s for the same job. Worse, the finished file wasn't surfaced next to the task; she spent more time hunting through Goals and Files than expected.
Every idea is a real post from someone who tried it, summarized in our words, with a link to the original. App names are swapped for plain words.