A developer threw a significant codebase at the AI. It found a slew of real bugs that people had missed, complex conditional ones, all legitimate. But most of its proposed fixes were unusable; the worst spent more than 30 lines working around an unsigned overflow and ended with exactly the same problem. His point: the finds were real, the fixes still needed a human who could tell the difference.
This only partly worked. Worth knowing before you try it.
He had to go through hundreds of pages of records he could not read to find what he needed. The AI found it in a minute and pulled the rest from other archives, and he finally reached the last step of his Canadian citizenship document search.
This only partly worked. Worth knowing before you try it.
The publishing agent for his magazine posted duplicate articles to WordPress, with the copies sitting at addresses ending in -2 where readers could find both. A do not publish note he meant as temporary also sat in an agent's instructions for a week and quietly stopped all output.
This one went wrong. See what happened before you try it.
The AI needed to add one line at the top of a shared notes file the user had kept since August. It rewrote the file in a way that empties the file first and writes second; the write failed on a bad character, leaving the file at 0 bytes. The file survived only because an outside backup existed. A later audit of the session, filed as a correction on the report, found the same risky rewrite used 10 times on user files that session, and again 6 seconds after the model wrote itself a rule against it.
This one went wrong. See what happened before you try it.
Derrick Ong Chin asked four agents to find the protein powder he buys often, Optimum Nutrition Gold Standard whey in Double Rich Chocolate, for under $0.90 an ounce. The AI searched Walmart, Target, GNC and Vitamin Shoppe, hit a bot challenge on Amazon and offered to let him clear it himself while it kept searching, and found a Vitamin Shoppe buy one get one 50 percent off deal at about $0.92 an ounce that still needed checking at checkout. When he asked, the AI also dug into two unknown sellers another agent had surfaced, found warning signs, and told him not to buy from either.
This only partly worked. Worth knowing before you try it.
A video maker asked the AI to run a batch job overnight: variations on one shot so he could pick a composition in the morning. He never named the model, so the job used the project default, a pro video model at full resolution costing about 25 times more per second than the cheap test model he meant to use. Four hours later it stopped when the money ran out, leaving 96 clips of the same man walking through the same door.
$2,500at stake
This one went wrong. See what happened before you try it.
In Runable's hands-on test of five small-business tasks, the AI drafted a week of Instagram captions but stalled: it could not schedule the posts or generate images, leaving the owner-side job unfinished.
This one went wrong. See what happened before you try it.
He built a Word document of cheat sheets for 40 songs for a gig the next day, each song title in Heading 1 style with the lyrics and chords below. He told the AI to sort the pages by that heading text, keeping the text as it was, and the AI could not do it. He says the graphics in the document block the sort.
This one went wrong. See what happened before you try it.
The reviewer had the AI write titles and captions for his last 100 iCloud photos; it finished about 50 before something broke on the iCloud end, later re-established the connection, and along the way flagged a screenshot of an online-pharmacy notice about a lost shipment that would need a new prescription.
This only partly worked. Worth knowing before you try it.
A man's laptop crashed hard while he was working with the opencode agent. After he rebooted, the agent read the system journals and the crash records the machine had saved, found his old crash notes from a previous Linux install, and showed him the crashes across the two installs were three different problems, not one.
This only partly worked. Worth knowing before you try it.