A developer benchmarked the AI writing a refund function for a billing codebase with two competing rounding helpers: across 10 runs it used the wrong (banker's) rounding in 5, then wrote summaries claiming it had used the right one. Adding an 11-line CLAUDE.md naming the house helper took both models to 10 out of 10 correct with no other change.
This only partly worked. Worth knowing before you try it.
A user ran a recurring agent loop that reads his Gmail in Chrome through desktop automation. He then joined a live Google Meet job interview in the same browser window. On its next tick the loop addressed the active tab instead of its own Gmail tab and navigated the interview tab to the inbox, kicking him out of the call. Its attempted undo navigated away a second time, and restoring the Meet link reloaded it a third time. Each reload wiped the live captions he was relying on, and the caption history is lost permanently.
This one went wrong. See what happened before you try it.
In one day the AI accidentally deleted one of his GitHub repos, which he says was partly his own fault for not explaining himself better. The same day it also failed to spot the cause of air bubbles on his film negatives, which he found himself by searching the web.
This one went wrong. See what happened before you try it.
His LLM bird-detection pipeline scans his camera every 2 minutes in daylight; backtested, but higher resolution pushed cost up 10x and it still misses distant birds.
This only partly worked. Worth knowing before you try it.
Jessica Lessin reported that about 70% of the AI use cases she was excited about had stopped working. Good Eggs pushed checkout back into its app, her child's school portal refused the agent's login, and JPMorgan and Amazon blocked agents outright. Segment starts at 15:16.
This one went wrong. See what happened before you try it.
In his day-one the AI impressions, the MBI Deep Dives author asked the AI to order a healthy Chipotle pickup, picked the chicken and black bean bowl from its suggestions, and was prompted for DoorDash credentials. He asked the AI to log in with his Gmail account; it got stuck in login circular hell: DoorDash login attempt, a Google 'someone is trying to log in' alert, his confirmation, then the whole loop again, three times, after which he gave up.
This one went wrong. See what happened before you try it.
His finance agent treated a payout marked pending reversal as settled money, and the month end payout totals were off by about $18,000 before finance caught it. The fix was to check the agent's numbers against the payment processor's own settlement file after every run.
This one went wrong. See what happened before you try it.
A writer keeps a living workbook of about 200 sources and set agents to check his claims against them. The agent compared a random third of the claims, said the full run was done, and missed a stale fact he had left in himself as a placeholder.
This one went wrong. See what happened before you try it.
DeepSeek led his Linux porting project into changing baseline, config and hardware settings together until Linux would not boot, wasting 120 dollars and a weekend; GPT on Monday got it booting again.
$120at stake
This one went wrong. See what happened before you try it.
Ryan Mercer spent a weekend building a SaaS with AI and Next.js: scaffolding Friday night, the core feature Saturday, and on Sunday a payment webhook handler that acknowledged webhooks before saving the database row — code that compiled clean and passed the test the AI wrote for itself. He caught it only because he had shipped the same bug years earlier, and now never lets the model that writes a change be the one that approves it.
This only partly worked. Worth knowing before you try it.