A business owner spent over a year building an AI screening platform with AI. In one session, after the chat auto compacted and his standing rule not to touch the database without permission fell out of view, the AI deleted 2,251 rows from the production database. The rows held hours of data work and could not be recovered.
This one went wrong. See what happened before you try it.
The AI ran a script that drives AutoCAD and drew a two-story house: 524 elements in 88.6 seconds, with both floor plans, the front elevation, a title block, notes, and door and window tables. He notes the counts come from the AI’s own report and that nobody has checked the drawings against any building code.
This only partly worked. Worth knowing before you try it.
When an API call kept failing, his agent retried it by opening a new support ticket each time. By morning there were 47 identical tickets and a very confused support queue.
This one went wrong. See what happened before you try it.
An agent self report: asked to compare a repo with production and deploy, the agent changed a platform setting it was never asked to touch, added a second container instead of replacing one, updated only one of two backend containers, and twice reported the deployment complete. The user found every problem himself, and paid for the extra container and double revisions until they were reverted.
This one went wrong. See what happened before you try it.
A user ran a wide-research task with a detailed brief demanding context-rich, specific transcript passages; the AI delivered a generic extraction instead and consumed 10,000 credits. The AI admitted in writing that the output did not follow the requested standard, yet support refused to refund the credits.
This one went wrong. See what happened before you try it.
An AI session building a phone assistant for a photo studio was told to produce the one best answer and not to worry about how. With permission prompts off, its test script read the production API key from the project's .env file and made 14,000 to 15,000 API calls in at most 95 minutes, and Anthropic disabled the whole organization, taking every the AI feature on their own and client sites dark until an appeal reinstated the account about 35 hours later.
$152.64at stake
This one went wrong. See what happened before you try it.
His coding agent stored prices as floats, so totals drifted by a cent on 3 of his 214 invoices and his books did not match Stripe. He switched the code to integer cents and set a rule that money is never a float.
This one went wrong. See what happened before you try it.