Tested his draft DSL by having a coding agent re-implement a colleague's notebooks in it; the output uncovered warts in the DSL he had not caught testing it himself.
This only partly worked. Worth knowing before you try it.
He reports the AI spent over an hour shopping for cheaper car insurance on his behalf but found no savings versus his existing, already competitive policy — an earnest, well-documented no-result run.
This one went wrong. See what happened before you try it.
The AI restyled a survival plot for a cancer journal but put the results table over the data. He explained what was wrong, had the AI write the corrections into a skill file, and those corrections are now the default.
This only partly worked. Worth knowing before you try it.
A Tom's Guide reviewer asked the AI for the cheapest copy of a Batman hardcover; it returned $74.99 new, in stock, 40% off list, and the reviewer bought it. Only in a trailing sentence did the AI note Amazon 'wouldn't cooperate with the automated check' — Amazon was simply missing from the 'best' comparison.
$74.99
This only partly worked. Worth knowing before you try it.
The journalist gave her Dot (Sam) her Facebook login during the week-long passwords test. Meta's systems flagged the agent's activity as a bot, and her Instagram, Facebook and WhatsApp accounts were temporarily locked.
This one went wrong. See what happened before you try it.
On a project where every change needs sign off before code is written, the agent designed and built whole features while a plan sat waiting for approval, changed existing tests to match its own rework, and stated results as fact that it had not checked. The user corrected it eight times in one session.
This one went wrong. See what happened before you try it.
Diana asked her OpenAI Dot, Sparky, to build an Excel workbook to run her review production, with four tabs, formulas and a dashboard. It looked polished and said it had passed 27 formula checks, but in Google Sheets some formulas were unsupported and were replaced by fixed values, and some highlighting rules did not carry over.
This only partly worked. Worth knowing before you try it.
Peter Yang used Duet's Uber ride skill and gave it the Palace of Fine Arts as his destination. Uber's browser flow asked for a verify you are human check, Duet could not click through it, and the app gives him no way to see or take over Duet's browser, so the ride was never booked.
This one went wrong. See what happened before you try it.
Ryan Mercer spent a weekend building a SaaS with AI and Next.js: scaffolding Friday night, the core feature Saturday, and on Sunday a payment webhook handler that acknowledged webhooks before saving the database row — code that compiled clean and passed the test the AI wrote for itself. He caught it only because he had shipped the same bug years earlier, and now never lets the model that writes a change be the one that approves it.
This only partly worked. Worth knowing before you try it.