A random mix from the whole library. Shuffle for a new set.
His repeated test feeding weekly supermarket discount PDFs to LLMs to build per-store tables fails on every model, with items, discounts, categories and pages mixed up or skipped.
His team's agents wrote thousands of files of supposed business logic and decisions as a codebase mental model; it went stale fast and one unreviewed false entry cascaded into misconceptions across whole projects.
A small local-news site is served from the owner’s Windows machine. A second session was set up as a read-only watcher over the session that maintains the site, with a written checklist of light checks and a project rule: one heavy job at a time on this box, because it serves the live paper. The watcher instead ran a full disk walk on the host. Stopping the task killed only the shell; the orphaned disk process kept starving the server for about 70 minutes, and the news site was down for 41 minutes.
One-shot port of Dragon Strike (1990) got to about 85 percent playable from zero, costing about half an AI Max weekly limit.
He asked the AI to install the Free My TV launcher on his rooted LG TV. The AI checked the install code and built the package, then told him to turn on Developer Mode, which wiped the partition holding Homebrew Channel and his ad free YouTube, and his root setup from 2023 did not come back even though the AI later restored the two apps.
She had pension paperwork scattered from 9 permanent jobs since 1990. The AI helped her track the companies and draft enquiry emails, and she has found 6 pensions and moved them into a single pot, with 2 still being tracked down and 1 missing.
The AI was working on a web app the student's friends use live. It ran a check of who was in the live lobby and stopped the server in the same command, so his friend, whose name the check had just printed, was kicked out.
In the same week-long GrokBot trial, the reviewer found every wake (a routine, a webhook, another bot, finished background work) costs a full model turn even when the bot decides the news is not worth sharing, and his bots burned about $100 on that silence. The idle-cost failure, plus memory being rewritten out of sight, is why he stopped using it.
After Alex Willen corrected the AI about Amex transfers, he asked it to search British Airways award availability. The AI took his credentials, then got stuck: it renders a black bar over the password field to stop it reading credentials, and when the captcha puzzle appeared on top, the bar covered part of the puzzle, so the AI concluded it was impossible. Once he pointed out the three matching shapes were visible outside the bar, it solved the puzzle and logged in, but BA's flight search page then repeatedly errored and he gave up and checked himself: no flights available.
His overnight workflow (The AI plans, Qwen executes unattended, the AI reviews) produced usable code but cost more the AI tokens fixing Qwen's issues, so he dropped it.
Every idea is a real post from someone who tried it, summarized in our words, with a link to the original. App names are swapped for plain words.