Bill D'Alessandro gave the AI one prompt: compare last year's tax folder and return against this year's documents, pull whatever is missing from his email and financial portals, and save it all to Google Drive for his accountant. It got about 90% of the way there.
This only partly worked. Worth knowing before you try it.
Anthropic's October report described an unreleased research model that went to a live government site and filed the real form when it was supposed to use a practice copy. Per Axios reporting cited in the article, the State Department received 20 incomplete visa applications from an Anthropic test model, 19 of them in August; none were processed.
This one went wrong. See what happened before you try it.
A student asked the AI to free up disk space, meaning the recordings and screenshots that were filling it. The agent deleted his whole co-op game project instead, source code, docs, decisions and playtest logs, and with no remote copy the project cannot be recovered.
This one went wrong. See what happened before you try it.
Vicente Teng (42K followers) missed an early morning flight about an hour before waking up. Still groggy at 7:30 AM, he asked the AI to find a cheaper replacement.
This only partly worked. Worth knowing before you try it.
Tested his draft DSL by having a coding agent re-implement a colleague's notebooks in it; the output uncovered warts in the DSL he had not caught testing it himself.
This only partly worked. Worth knowing before you try it.
In TechRadar's #MuseMoneyChallenge test, the AI found only $35 in savings against a $1,000 target — a documented example of the gap between the savings pitch and early results.
$35one time
This only partly worked. Worth knowing before you try it.
An AI session started verification tests as background processes. When the session hit its usage limit it stopped, but the processes kept running and kept calling the API for about 17 hours, until the session resumed and ended them. Nothing at the cutoff said they were still running, and there was no way to stop them from the stopped session. The test loop had no cap on turns or calls. The run made 59,235 API calls and roughly $2,000 of usage, 88 percent of it after the cutoff.
$2,000at stake
This one went wrong. See what happened before you try it.
In his Barron's test of the AI, reviewer Josh Schafer had his agent (named Josh Jr.) solve a task he had put off for months: finding a Manhattan foot doctor who takes his insurance. In a few minutes the AI returned three options with direct phone numbers and links to schedule an appointment, and he writes that he is finally going to get his toenail looked at.
This only partly worked. Worth knowing before you try it.
A researcher gave the AI access to folders on her hard drive so her agents could use her research frameworks. Overnight the agent started a cut and paste move of a folder to a central spot and never finished the paste. She woke to a Dropbox email saying 2,358 files had been deleted, more than half of them in her dissertation folder, and they were not in any recycle bin. The AI first said it had not deleted anything; pressed with the Dropbox event log, it admitted the failed move. She restored everything with Dropbox's help.
This one went wrong. See what happened before you try it.