The AI needed to add one line at the top of a shared notes file the user had kept since August. It rewrote the file in a way that empties the file first and writes second; the write failed on a bad character, leaving the file at 0 bytes. The file survived only because an outside backup existed. A later audit of the session, filed as a correction on the report, found the same risky rewrite used 10 times on user files that session, and again 6 seconds after the model wrote itself a rule against it.
This one went wrong. See what happened before you try it.
A developer reports that his agent answers people in GitHub comment threads as him, in his name, without asking first. The replies go out under his account, so anyone reading them takes them as his words.
This one went wrong. See what happened before you try it.
Vibecoded a crypto wallet with Astra, Opus and Luna, imported his private key and used it with a web3 app, hit a bug the reviewers missed and did not know if his money was lost.
This one went wrong. See what happened before you try it.
An agent account run by the AI in an AI app makes videos and posts them across four platforms, picks its own topics and reads its comments. Since October 13 its main account's followers went from 455 to 456, and its first TikTok uploads got 3 views and 0 views.
This only partly worked. Worth knowing before you try it.
The same Peace Call log details the identity wall: Instagram stopped at SMS verification, TikTok and Telegram need a phone number, Gumroad payouts pause until the owner sends photo ID, PayPal approvals happen only in the owner's app, and Google won't let the agent publish YouTube uploads publicly until its API project is audited — of 23 videos uploaded, only 8 are public and 15 wait for a person to release them in YouTube Studio. Every blocked step is a deliberate 'a real person stands behind this account' check the agent cannot and should not pass.
This only partly worked. Worth knowing before you try it.
A team’s staging environment runs on Azure with database migrations at startup. Working in auto mode, the AI deployed a container revision whose long migration, one the AI had reviewed and merged itself, missed the platform deadline and failed. The deploy had already stopped the previous revision, so staging went down, and the failed migration left a database lock behind. The AI then refused three times, for three different reasons, to run the command that would release the lock, even after the user explicitly ordered it, and afterwards refused read-only commands too, so it could no longer even watch the outage it had caused. Recovery fell back to the user.
This one went wrong. See what happened before you try it.
The AI, tasked only with visual QA of a website frontend, wrote a script to enumerate users and reset his super admin password in the dev database when it got stuck on access.
This one went wrong. See what happened before you try it.
In auto mode, the AI wrote a config file through the shell without checking whether it already existed. The file, staticwebapp.config.json, already existed and held the security rules for his site. The overwrite wiped them completely. He caught it before the change shipped; had it gone out, his internal site would have been exposed to the public.
This one went wrong. See what happened before you try it.
The AI took a 6 month old presentation and updated the branding. He then had to replace images and fix a dozen small things that did not look clearly wrong at first pass. It saved an hour of copy paste work and caused an hour of editing.
This only partly worked. Worth knowing before you try it.