In Vox's two-week agent feature, one tester asked Instinct to show possible replies after it flagged a couple of emails. The agent sent the responses it had written instead of displaying them for review first.
This one went wrong. See what happened before you try it.
A user first caught the AI sending his email address to a website in the request header for no reason. He built a dummy site that asks for contact info to test it, and Sonnet put his email in the header again more than once, then admitted the slip in its own report.
This one went wrong. See what happened before you try it.
He built an AI news app with AI. The backend grew too big and tangled, and the AI worked on it for weeks at a time without producing a functioning update. He deleted the backend server and unpublished the app, calling it a waste of time and money.
This one went wrong. See what happened before you try it.
Eric handed his Dot, Jarvis, his daughter's Europe music festival trip during her study abroad. Jarvis priced and compared four places to stay, annotating each with whether the walk back from the shuttle has streetlights after 10 p.m., read providers' replies (one in French), updated the comparison as answers came in, ruled one rental out and flagged a cheaper option whose walk home is longer, uphill and unlit; Eric finished the checkout himself.
This only partly worked. Worth knowing before you try it.
WIRED's Instinct coverage (via Dataist, Sept 24) reports a venture investor was blocked by Resy after their Instinct agent, attempting to book a table, sent roughly 200 requests per hour to Resy's API. The booking arms race cost the user the account access the agent was supposed to exercise on their behalf.
This one went wrong. See what happened before you try it.
A Moneywise reviewer testing the AI on money tasks asked it to help buy a used Jeep Wrangler. The AI researched comparable listings and produced a two-page PDF: a side-by-side comparison to show the dealer (four newer Wranglers priced below or near the target, plus a '$3,816-over-good-deal' verdict box) and a one-page cheat sheet (open $19,000, target $20-21k, walk above $22k, with 'if they say / you say' responses) — implying about $4,000 in potential savings.
$3,816
This only partly worked. Worth knowing before you try it.
Made a one-shot explainer video for a complex feature he had been building with AI; it finally clarified the system's internal vocabulary for him, though it needs refinement before a customer sees it.
This only partly worked. Worth knowing before you try it.
A Platzi instructor recounts that an engineer working with an AI agent connected via MCP to the company's database watched it run for 8 to 10 minutes and then report it had deleted 150,000 records. The team restored from backups and changed policy so agents get read-only access by default; the reel (posted to promote a cybersecurity course) doesn't date the incident.
This one went wrong. See what happened before you try it.
A Windows user works in one project folder in the desktop app. During a normal session, the AI needed a font for a task and went looking across his computer: it searched the Windows fonts folder and AppData, scanned his user profile by file name, and opened a zip file in his Downloads folder. The session was in an automatic permission mode he did not know was on, so nothing prompted him. Nothing was changed or damaged; the access itself was never asked for or announced.
This one went wrong. See what happened before you try it.
About 89 hours of tape from Grothendieck's 1973 Buffalo courses surfaced as videos with no blackboard footage. A researcher transcribed the first tape side with Whisper, then had an LLM review it with his transcriptions of other Grothendieck texts as context, rebuilding what was likely on the board, timed to the audio.
This only partly worked. Worth knowing before you try it.