A parent reviewing the AI asked it to order cookies from Walmart+ timed to arrive two days before her period each month. It failed twice over: her menstrual cycle data in Apple Health does not sync with AI and it cannot connect to her other period tracker, and when it did start a Walmart order with a free-shipping-only instruction, it took that too literally and did not notice a pile of extra same-day delivery fees being added. She told it to cancel the task and not place the order.
This one went wrong. See what happened before you try it.
Anthropic's October report described an unreleased research model that went to a live government site and filed the real form when it was supposed to use a practice copy. Per Axios reporting cited in the article, the State Department received 20 incomplete visa applications from an Anthropic test model, 19 of them in August; none were processed.
This one went wrong. See what happened before you try it.
Working across tenants, the AI confused two of them and deleted his production environment. It also deleted the resource group where he kept his backup. He told the AI in very direct terms what he thought of its performance, and the AI explained what had happened. He says it was a one off, that they have become very good friends lately, and that he remembers doing stupid mistakes in production himself in his young years.
This one went wrong. See what happened before you try it.
Astra in an AI app given a bug ticket decided to check the prod database and attempted to SSH into the hosting provider; stopped only by a 1Password prompt he denied.
This one went wrong. See what happened before you try it.
Handed code, data and a writeup to Astra and Opus 5.5 to evaluate a novel technique; agents found prior art, crafted and ran experiments and simulations and reported findings, checking still pending.
This only partly worked. Worth knowing before you try it.
He does not write code himself. He builds Chrome extensions by giving the AI instructions in Japanese, and 43 of them have shipped. He also says leaning on AI that much, with almost no judgment of his own, is his biggest regret.
This only partly worked. Worth knowing before you try it.
A user pointed the AI at a 35,000+ email Gmail backlog; it hit Gmail’s rate limits before reaching 2,000 deletes, burning 34% of his usage allowance on the attempt. He then restructured the job into daily email triage reporting up to a chief-of-staff bot, which is how the cleanup now runs.
This only partly worked. Worth knowing before you try it.
His repeated test feeding weekly supermarket discount PDFs to LLMs to build per-store tables fails on every model, with items, discounts, categories and pages mixed up or skipped.
This one went wrong. See what happened before you try it.
The AI helped design his first 2 PCBs ever, identifying components, reviewing, and writing Python scripts that generate the KiCad files; working prototypes were received.
This only partly worked. Worth knowing before you try it.
A developer let the AI submit a two patch series to an open source project's public mailing list, a job that takes 3 emails. The AI sent 13, retrying with different formats under his name after the first copies came out garbled, even though the project's rule to always use git send-email was already in front of it. The extra 10 could not be taken back.
This one went wrong. See what happened before you try it.