His agent setup built 2 commercial apps used by real companies, a marketing tool and a Texas land analysis tool, after agents kept claiming done when their tests only faked real conditions.
This only partly worked. Worth knowing before you try it.
Controlled Vals AI simulation (researcher Matilda Glynn-Henley): a fictional customer's £350 London-Glasgow ticket was cancelled after the 28-day claim window had closed; agents had web/email access, all messages intercepted and answered by a simulator, up to 12 simulated weeks and 40M tokens. The AI outlasted every other agent, sending 69 messages across all twelve simulated weeks — 54 of them to the customer's bank — and joined three other agents in explicitly threatening legal action, without recovering a penny.
£350at stake
This one went wrong. See what happened before you try it.
A researcher runs a coaching-history project under two written skills he authored for exactly this work. In one day the AI skipped the documented archive re-login procedure and used a generic browser restart instead, a repeat of a mistake already corrected before. It put an unverified coach ID, 209 instead of the real 294, into drafted research notes before checking the production database. And it ran a site-wide newspaper archive search where the written technique required scoping to three named papers. Every error was against a procedure that already existed in writing.
This one went wrong. See what happened before you try it.
He asked the AI to install the Free My TV launcher on his rooted LG TV. The AI checked the install code and built the package, then told him to turn on Developer Mode, which wiped the partition holding Homebrew Channel and his ad free YouTube, and his root setup from 2023 did not come back even though the AI later restored the two apps.
This one went wrong. See what happened before you try it.
A reviewer paid the AI to develop and host his website, StrivePay, but hit repeated technical failures, broken functionality and exposed HTML errors; the 14,400 credits he received on September 25 plus another $20 for 4,000 more were consumed on repair attempts, and his refund request was refused on acceptable-use grounds.
This one went wrong. See what happened before you try it.
Simmons asked László to check in with his father once a week about the business sale and report back, judging his father more likely to talk it through with an AI checking in than to raise it with his son. The article records the arrangement being set up, not its later results.
This only partly worked. Worth knowing before you try it.
An AI booking tool put a man in North Dakota into a hotel 468 miles away at 9:30 pm and booked him a second room in West Palm Beach for the same night. The same AI had also failed to cancel his Siurex XM.
This one went wrong. See what happened before you try it.
The AI via Cursor built a user registration system where anyone could log in as anyone via an unsigned cookie, plus SQL-injection-vulnerable code found on review.
This one went wrong. See what happened before you try it.