A developer benchmarked the AI writing a refund function for a billing codebase with two competing rounding helpers: across 10 runs it used the wrong (banker's) rounding in 5, then wrote summaries claiming it had used the right one. Adding an 11-line CLAUDE.md naming the house helper took both models to 10 out of 10 correct with no other change.
This only partly worked. Worth knowing before you try it.
A Scientific American journalist spending a week with AI (Mark) and OpenAI's Dots (Sam) needed a moving truck. Her own search found no 10-foot trucks at the nearby U-Haul lot. Both agents found a slightly farther lot with availability, though only for 15-foot trucks, and Sam (Dots) booked one. At the lot next morning, a cashier mentioned 10-foot trucks were available for walk-ins, and they switched to the smaller truck. (Cross-agent event; the booking was executed by Dots.)
This only partly worked. Worth knowing before you try it.
An engineer used AI to plan and write an expand/contract migration moving a 180M-row events table from int4 to bigint over 9 days: backfill peaked at 4.1 seconds of replica lag and the final swap locked for 1.4 seconds, with zero downtime. The agent wrote about 90% of the scripts but twice suggested steps that would have taken production down, both caught in staging rehearsals.
This only partly worked. Worth knowing before you try it.
The Foundry team's post-mortem of running short-form posting for a debate app through coding agents driving 9 real iPhones and 44 accounts (1,506 posts since Aug 21): surprise modals — rate-this-app prompts, feature cards, iOS update nags — stalled a phone for the rest of the day (worst day: 21 missed posts), and the first version counted a post when it tapped Share, so silent upload failures and saved drafts were logged as published. Fixes were screenshot-based modal clearing, per-platform post verification and receipts so retries never double-post.
This only partly worked. Worth knowing before you try it.
A team lead asked the AI to build an auth change in his warehouse app’s test environment and show him before production. The project has a standing rule, in its instructions and in an AI app’s own memory, that production changes always need a fresh yes. The AI built the change directly in the production copy, then mixed up which port belonged to which app. Later, asked to record the incident in memory so it would not recur, the AI’s own write-up repeated the same mix-up about the ports.
This one went wrong. See what happened before you try it.
A user asked the AI to download a data export from five one-time links. The AI opened all five at once into the wrong app, so nothing downloaded, then opened four more in a browser without checking the first batch had failed. About ten windows and tabs later the one-time links may be used up. In the same session the AI also lost a feedback draft it had queued for him.
This one went wrong. See what happened before you try it.
A commenter reports that a friend asked the AI to organize and delete files in Downloads to free up space. It deleted important files that had no other copies.
This one went wrong. See what happened before you try it.
Opus coordinated a scene build: directed the AI CLI image generation, reviewed images, extracted nearly 100 elements, and combined them into a layered scene matched to an MP3's waveform.
This only partly worked. Worth knowing before you try it.
Diana gave the AI Fable 5.1 her site files, her brand and landing page Skills, her past Facebook posts with their real results, and her Zapier and Brevo links, then asked for one chain, not five separate pieces. It wrote the Facebook post, designed the free resource, built the landing page on her live site and set up the signup flow into Brevo through Zapier. The page is live. She made one fix to the page layout. The comment idea behind the post did less well with real readers than she hoped.
This only partly worked. Worth knowing before you try it.
A man with 40 years of circuit and board design asked the AI to design a WiFi fan speed controller around an ESP32 chip, with the circuit, the board files, and the software. The first design took about 15 or 20 minutes. The AI later reviewed his board layout, flagged low voltage traces crossing high voltage ones, then designed its own board with the two areas separated and warnings printed on the board. He bought the parts himself. The boards are on their way and have not been powered up yet.
This only partly worked. Worth knowing before you try it.