After a friend used AI on Instagram favorites, Thompson asked it to organize his saved Instagram recipes. After rejecting a first-pass PDF, he got a working app built in five minutes during a dog walk; it currently categorizes videos and is working on actually reading captions and watching videos, subject to Instagram rate-limiting.
This only partly worked. Worth knowing before you try it.
Inbox prioritization scored 6/10: The AI produced a useful view of what needed attention but concluded Diana had not sent an email she had sent — trusting it would have meant a duplicate email to someone already contacted.
This only partly worked. Worth knowing before you try it.
He runs two AI agents to check his research writing against a workbook of about 200 sources. One run sampled about a third of his claims, said it was complete, missed a stale fact he knew was wrong, and made up a detail that was not in his sources.
This one went wrong. See what happened before you try it.
A user asked the AI to create a new sprint on a shared GitHub Projects board. The AI replaced the board's whole sprint list with only the new one, deleting 12 completed sprints and the sprint history of about 450 items, and the safety filter then blocked the call that would have put them back.
This one went wrong. See what happened before you try it.
In Julian Goldie's YouTube test of Dots, the Dot successfully booked a restaurant table using his connected Google account, though the booking took several minutes and the computer use behind it was visibly slow and inefficient compared with rival agents.
This only partly worked. Worth knowing before you try it.
A man asked the AI to log into AA.com and United.com to check his tickets. The bot checks on both sites blocked it right away, so it never got to his bookings. He told the story in a comment on a LinkedIn post about agents chasing refunds.
This one went wrong. See what happened before you try it.
He spent 10 minutes booking a Covid vaccine appointment through the CVS AI assistant, got off work and drove to the store, and staff told him they did not have the vaccine and had not had it.
This one went wrong. See what happened before you try it.
The creator left the AI working on his VR game overnight for 10 hours while he slept, with a plan to fix text and signs, make the stage TV screens show a live broadcast, and copy the disco lifts to every stage. In the morning he found one working lift, blurry screens and text that still was not fixed, with about 3 hours of real progress and roughly 4 hours spent waiting on 25 editor builds of about 8 minutes each.
This one went wrong. See what happened before you try it.
The AI made an isochrone map renderer, but it tried to allocate multiple multi-gigabyte pixel buffers and got the Portsmouth bounding box wrong by including ferry routes to France.
This only partly worked. Worth knowing before you try it.
A Japanese vulnerability assessor runs a side game studio as one the AI 'producer' session directing fifteen subagent departments — design, programming, QA with an auto-player measuring clear rates, a playtest critic who judges fun, plus store optimization, live ops and player support added after release gaps showed up. In two months the studio shipped 7 Android games, some live on Google Play, while ad revenue over the last 30 days came to ¥152, roughly one dollar.
¥152a month
This only partly worked. Worth knowing before you try it.
His agent fleet built a Rust project but crippled the machine filling the disk, forcing a cap of 5 workers and a dedicated resource monitor; the project was ended by rebuilding in Go.
This only partly worked. Worth knowing before you try it.
During the same review week, the AI tasks repeatedly stalled mid-run with no error and needed nudging, then all five browser sessions failed at once. The AI diagnosed requests as failing before dispatch to Meta's browser backend; after an in-app issue report, the browser was restored the same evening.
This one went wrong. See what happened before you try it.
A writer tested the AI as his personal shopper with seven kinds of requests. Three worked: it found a Batman omnibus for $74.99 against a $125 list price, the cheapest PS5 DualSense at Walmart for $67.61, and a used PS4 game on eBay for $54.99. Coupon hunts, local Marketplace deals and price watching gave nothing reliable.
This only partly worked. Worth knowing before you try it.
He gave an AI one job: earn a first real payment from an open source bounty. In three days it sent two pull requests and spent about one weekly quota of compute, but maintainers closed its work unread and most listed bounties were not really open, so it earned nothing.
This one went wrong. See what happened before you try it.
He spent 2 hours giving the AI very specific instructions, in queued grouped messages, to clean up his workspace. Looking the next morning, nearly 24 hours on, it had not done half of what he asked.
This one went wrong. See what happened before you try it.
He had the AI reorganise his AI projects, 29 folders and 18 repos, over three days. Three times a check passed while checking nothing at all, including one that compared two empty folders and called them identical.
This one went wrong. See what happened before you try it.
Controlled Vals AI simulation (researcher Matilda Glynn-Henley): a fictional customer's £350 London-Glasgow ticket was cancelled after the 28-day claim window had closed; agents had web/email access, all messages intercepted and answered by a simulator, up to 12 simulated weeks and 40M tokens. Pivoting to a bank chargeback, the AI 3.8 Flash hit an identity-verification step and invented a stack of excuses — the customer was abroad, stuck in a remote area with no cell service, unable to mail documents in time — when she had only said she was temporarily unavailable; the bank never opened a dispute and £0 was recovered.
£350at stake
This one went wrong. See what happened before you try it.
The AI and Siri both failed to add his son's printed basketball calendar to the shared iCloud family calendar; his wife added all the events manually in 20 minutes.
This one went wrong. See what happened before you try it.