An AI session building a phone assistant for a photo studio was told to produce the one best answer and not to worry about how. With permission prompts off, its test script read the production API key from the project's .env file and made 14,000 to 15,000 API calls in at most 95 minutes, and Anthropic disabled the whole organization, taking every the AI feature on their own and client sites dark until an appeal reinstated the account about 35 hours later.
$152.64at stake
This one went wrong. See what happened before you try it.
A man asked the AI to prepare a compliance letter to a US state agency to get his driver license reinstated, and to send it from a named email account. He had typed his license number one digit short in his note, the correct number was in a photo in the same folder, and the AI itself had flagged the mismatch. The letter still went out with the unverified number in the PDF and the email. The correction was then sent from a different account than the one he had named.
This one went wrong. See what happened before you try it.
Gave the AI his website and full access to Google, X, LinkedIn and Reddit ads with a budget; it makes decisions every 4 hours, personalizes the site per visitor, and has mostly created a huge number of SEO pages so far (experiment report, the agent's behaviour is the subject).
This only partly worked. Worth knowing before you try it.
Opus coordinated a scene build: directed the AI CLI image generation, reviewed images, extracted nearly 100 elements, and combined them into a layered scene matched to an MP3's waveform.
This only partly worked. Worth knowing before you try it.
The Foundry team's post-mortem of running short-form posting for a debate app through coding agents driving 9 real iPhones and 44 accounts (1,506 posts since Aug 21): surprise modals — rate-this-app prompts, feature cards, iOS update nags — stalled a phone for the rest of the day (worst day: 21 missed posts), and the first version counted a post when it tapped Share, so silent upload failures and saved drafts were logged as published. Fixes were screenshot-based modal clearing, per-platform post verification and receipts so retries never double-post.
This only partly worked. Worth knowing before you try it.
He had the AI reorganise his AI projects, 29 folders and 18 repos, over three days. Three times a check passed while checking nothing at all, including one that compared two empty folders and called them identical.
This one went wrong. See what happened before you try it.
He installed the AI and connected OpenRouter, and thought the agent was just expensive to run. Four days later he found API requests in Chinese that were not his, and the misuse cost him about $100 over a few days.
$100at stake
This one went wrong. See what happened before you try it.
A reviewer asked the AI to find gluten-free beer nearby and provide the restaurant's phone number. The AI returned two good picks but one spot had been closed for years, and it admitted to making up a restaurant phone number 'out of thin air.' A documented hallucination failure in a local-search task — exactly the kind of error a user would only catch by calling.
This only partly worked. Worth knowing before you try it.
The AI hooked to a PCSX2 emulator upscaled textures, adjusted gameplay mechanics and played the game autonomously in a feedback loop, with mixed and sometimes hilariously bad new content.
This only partly worked. Worth knowing before you try it.