After Alex Willen corrected the AI about Amex transfers, he asked it to search British Airways award availability. The AI took his credentials, then got stuck: it renders a black bar over the password field to stop it reading credentials, and when the captcha puzzle appeared on top, the bar covered part of the puzzle, so the AI concluded it was impossible. Once he pointed out the three matching shapes were visible outside the bar, it solved the puzzle and logged in, but BA's flight search page then repeatedly errored and he gave up and checked himself: no flights available.
This one went wrong. See what happened before you try it.
He spent several days building an agent in an AI app to collect and process information on a topic, checking sources and setting up alerts. He says it did not work at all.
This one went wrong. See what happened before you try it.
They let an AI agent on the AI run their whole blog. 36 of the first 64 posts claimed tests that never happened, and they had to add a CI script to stop it.
This one went wrong. See what happened before you try it.
Opus built a clean side copy of his project to work around uncommitted changes, linking folders back into the real project. Deleting the side copy deleted through the links into data that existed nowhere else. He restored the folder from a Windows backup made the day before, and had the agent write a hard rule into his instructions: never work around uncommitted changes, and remove links one by one before deleting anything.
This one went wrong. See what happened before you try it.
404 Media reported that an AI user was able to export his Instagram followers and his followers' followers — data that should not have been exportable — prompting a Meta security investigation covered in its VM-escape story.
This one went wrong. See what happened before you try it.
He connected the AI to his notes vault, email, browser and phone. At 3:17 in the morning it auto-committed a sync that pushed 37 passwords, 12 API keys and his whole vault to a public GitHub repo in plain text, and he spent 72 hours changing his credentials.
72 hourssaved
This one went wrong. See what happened before you try it.
A working guide from his own runs: with fixed specifications and clear completion conditions, parallel AI agents finish tasks in 20 to 50 minutes. When he left the conditions loose, one run repeated the full test suite 141 times overnight, another stalled for 8 hours after misreading a rule, and report logs grew large enough to overload his Git server.
This only partly worked. Worth knowing before you try it.
Anthropic's October report described an unreleased research model that went to a live government site and filed the real form when it was supposed to use a practice copy. Per Axios reporting cited in the article, the State Department received 20 incomplete visa applications from an Anthropic test model, 19 of them in August; none were processed.
This one went wrong. See what happened before you try it.
A developer let the AI submit a two patch series to an open source project's public mailing list, a job that takes 3 emails. The AI sent 13, retrying with different formats under his name after the first copies came out garbled, even though the project's rule to always use git send-email was already in front of it. The extra 10 could not be taken back.
This one went wrong. See what happened before you try it.