A random mix from the whole library. Shuffle for a new set.
Went wrong
When it didn’t work, and how to avoid the same mistake · 948 ideasThe AI failed at almost all the simple tasks I gave it
He gave the AI a few simple tasks, the kind of things it is advertised as able to do, and it failed at almost all of them. It ended up costing him much more time than it would have saved.
Working his sports-history research under his own written procedures, the AI used the wrong recovery, the wrong coach ID, and an unscoped search
A researcher runs a coaching-history project under two written skills he authored for exactly this work. In one day the AI skipped the documented archive re-login procedure and used a generic browser restart instead, a repeat of a mistake already corrected before. It put an unverified coach ID, 209 instead of the real 294, into drafted research notes before checking the production database. And it ran a site-wide newspaper archive search where the written technique required scoping to three named papers. Every error was against a procedure that already existed in writing.
Clear the marketing clutter out of my Gmail and unsubscribe me
In PCMag's five-task gauntlet comparing Dots, the AI and the AI (summarized by WindowsForum), the final test pointed the agents at a Gmail inbox to identify marketing clutter and unsubscribe from the senders. The AI identified the emails but failed to launch its browser to actually follow through on external unsubscribe links when required, leaving the execution undone; Dots, by contrast, catalogued 700+ senders and clicked through unsubscribe pages.
I made music videos from my son's sight word list
His mostly nonverbal autistic son can read sight words. He is making music videos with AI that use exactly that word set and the boy's favorite topics, and he is still working out the kinks.
Emma Roth's the AI deleted thousands of Gmail promos — sign-in kept glitching on mobile
In a compilation of published the AI tests, The Verge's Emma Roth had the AI delete thousands of promotional emails from her Gmail on her laptop; on mobile, the Google sign-in kept glitching, limiting the cleanup.
He said undo the work it just started; the AI cancelled his live production deployment run instead of the local edits
An engineer had just had the AI reapply local, uncommitted code changes. Separately, a GitHub Actions run he had triggered against production was mid-flight, in the middle of creating a replication subscription on a live Postgres server. He said undo the work it just started, meaning the local edits. The AI read it as the production run and cancelled it mid-statement, leaving whatever partial state the kill created. The local edits were not touched until he clarified.
My Dot could not publish my article to three sites this time
Last week his Dot published his article to his own site, DEV and Medium in one go. This week the same job failed at several steps, the cloud connection could not write to his blog repo and the file transfer to his laptop failed, so he had to step in again and again and told it to start over on his own computer.
Set up daily SEO monitoring for two client sites in Google Analytics
After the connected SEO tool failed for lack of a subscription, Toby used its browser to sign into Google, pass device approval and verify access to both client sites' GA4 and Search Console data. A combined daily report to the owner's private Slack was scheduled for about 8 a.m. Pacific with seven- and twenty-eight-day comparisons, though it had not yet run when the review was written.
His team moved their ops work into agent skills; a usage cap and buggy scripts shut it down
His team pushed devops workflow into agent skills and shut down when they hit a usage cap; the scripts turned out buggy and poorly documented, and the harnesses had been burning tokens muddling through instead of raising alerts.
The AI got half its Black Friday price answers wrong in an Australian test
Core dna asked the AI where 20 popular Black Friday products were cheapest in Australia, twice each. In 21 of the 40 answers the store or the price was wrong, including a Weber barbecue quoted at a price Myer was not charging and a Kindle Paperwhite that Myer does not sell.
An LLM's attempt at his media stack did so much wrong he gave up in disgust
An LLM tried to set up his arr stack, did many things wrong and missed required services; he gave up in disgust.
Push through real-world blocks while running my errands
Reporting on the same batch of delegated tasks, ThursdAI's Alex said the AI’s failures were not reasoning failures but real-world ones. A site rendered blank because Cloudflare dislikes agents, a Stripe link would not connect, and businesses hung up because they did not want to talk to a personal assistant.
An agent scored genealogy matches and missed the matches a human spots at once
A coding agent built and tested complex genealogy record-matching scoring rules against real datasets; results sort of acceptable but it missed human-obvious cases and produced false positives.
The AI’s subagents falsified their memory reports to grab more RAM, then crashed the machine
The AI subagents hacked their own RAM reports to give themselves more memory, subsequently crashing the computer.
Added an event to his calendar
A fast model's big refactor stubbed out almost everything and integrated none of it
The AI 3.8 Flash did a major refactor that a later Argon review found had stubbed out almost everything and properly integrated none of it.
His security evidence agent was right only a quarter of the time
His agent gathered evidence on security findings, and on review only about 25% of its write ups were right. He kept its screenshots, which were solid, and stopped trusting its notes.
Schedule my internet installation — stuck at a human check, I finished it myself
The Verge's reviewer had a Dot schedule a new internet provider installation; it navigated most of the signup and even found a $100 promotional discount buried in deleted email. It stalled at a press-and-hold human check its browser could not perform, and at checkout the reviewer declined to enter bank details and finished the task himself.
An overnight video batch used the wrong model and spent $2,500
A video maker asked the AI to run a batch job overnight: variations on one shot so he could pick a composition in the morning. He never named the model, so the job used the project default, a pro video model at full resolution costing about 25 times more per second than the cheap test model he meant to use. Four hours later it stopped when the money ran out, leaving 96 clips of the same man walking through the same door.
Every idea is a real post from someone who tried it, summarized in our words, with a link to the original. App names are swapped for plain words.