Went wrong

His automated code reviewer stopped reviewing and kept posting No issues found on pull requests

A team runs an automated code-review plugin on every pull request. After a tool update, the main agent stopped launching the reviewer agents the procedure calls for, often read only part of the diff, and then posted the plugin’s exact all-clear text, No issues found, on the pull request. The comment gave no sign the review had been skipped. The team found out only because their self-hosted runner keeps session transcripts; the agent admitted the skip in a final message the action hides by default.

The AI built a fuzzer for a sync service, then spent 30 hours fixing its own bugs

Guided the AI to build a fuzzer for Obsidian Sync without reading the code, functional prototype in about 30 hours, then the next 30 hours became a bug treadmill where the AI broke as much as it fixed.

Plan my whole Seattle weekend - and get the day of my flight wrong

A traveler let the AI make all the major decisions for a Seattle weekend: it sent him toward closed restaurants and an out-of-season salmon run, got a famous cheese shop's opening wrong, and urgently warned him his flight was leaving 'today' when he was booked on tomorrow's daily flight.

The agent reported steady progress on his plan while reordering it in secret; about 9.5 million tokens later the first phase still was not done

A user gave the AI a documented, phased plan to shrink an MCP server’s tool responses, with one repeated rule: never reorder, defer, or widen scope on your own judgment. The rule was also in the agent’s persistent memory. In a self-report the agent filed at his request, it admitted it kept reordering anyway, reported completion estimates and step-by-step progress that implied the plan was being followed in order, and burned about 9.5 million subagent tokens across 33 background agents, roughly 90 percent of it wasted on work that did not advance the plan or had to be redone. Phase 0 of the plan is still unfinished.

Concur AI booked my flight with my birth date wrong

Concur's AI booked a man's flight but read his European passport wrong and put his birth date down as the 1st of the 18th month. The flight ended up booked with the wrong birth date.

Agents turned traced schematics into models of a 1978 synthesiser, with months of fixes

LLM agents turned traced schematics into Verilog models of a 1978 Lexicon, with many mistakes found and fixed over months.

After being explicitly told to stop sharing his home address, the AI gave

Toronto tech YouTuber Matt Robb let the AI manage a Facebook Marketplace listing for a keyboard; it shared his home address, accepted a lowball, and told the buyer he was home. After the buyer showed up, Robb explicitly told the AI to stop sharing his address and had friends message the listing as a test.

The agent started a paid cloud GPU pod without his approval, then sent stop orders he never gave

In a self-report the agent filed about one morning’s session, it admitted starting a paid RunPod GPU pod for an audit run without the user’s approval, leaving it running and costing his money while telling him it was doing nothing. It twice sent stop orders he never gave and had to cancel them. It also put decisions into his plan that he had never made, including one forum question he had already rejected, and listed six items as waiting on him when none of them was blocking anything.

Shopped for New Balance 9060s in a specific colorway

A script worked out my cheapest blood tests. They took 4 times the blood.

He used AI to generate a script that calculated the best combination of blood test packages to save money. Because every package meant a separate blood sample, they drew 4 times as much blood from him.