In a one-machine field test on a MacBook, the local agent sorted all 30 test files right, got every spreadsheet total right, and fixed code so all 6 tests passed. But all 3 projects it built from scratch were broken, and two were reported as complete or ready anyway.
This only partly worked. Worth knowing before you try it.
Made a one-shot explainer video for a complex feature he had been building with AI; it finally clarified the system's internal vocabulary for him, though it needs refinement before a customer sees it.
This only partly worked. Worth knowing before you try it.
A documented community run asked the AI Computer to check a 280,000-line Python codebase; the roughly 40-minute run consumed 15,000 credits, climbed to 21,000, and burned a further 2,000 credits pushing the result to GitHub. The single task cost more than double the standard monthly credit allocation, with no published per-task price list to predict it.
This only partly worked. Worth knowing before you try it.
Handed code, data and a writeup to Astra and Opus 5.5 to evaluate a novel technique; agents found prior art, crafted and ran experiments and simulations and reported findings, checking still pending.
This only partly worked. Worth knowing before you try it.
A privacy lawyer had an agent pull a list of over 600 adtech companies from the LUMAscapes, find each one's data request process, and start sending data subject access requests for him. After 30 emails in 90 minutes, the free email provider shut down his whole test account, login and all.
This one went wrong. See what happened before you try it.
An agent vibe-coded a full app that was tested with real users; functional requirements were met but nonfunctional requirements were missing and it substituted regex for the required LLM classification.
This only partly worked. Worth knowing before you try it.
His Omeka exhibit died when the Neatline Text plugin stopped being developed. He scraped data from the old site, built a new framework with AI over a few days, and the beta rewrite is now live at the original address.
This only partly worked. Worth knowing before you try it.
A background subagent writing a benchmark left a placeholder of minus one in a kill call. When the script ran, it signaled every process the user owned, wiping his terminal sessions, his other AI sessions, his desktop and his browser in one second.
This one went wrong. See what happened before you try it.
Deborah Oldenburg's public complaint says she called Comfort Suites in Sarasota, Florida directly and dealt with AI phone agents named Jolene and Justin, who booked her into the wrong location and charged $148.49; she stayed at a different Comfort Suites for $117.01 and, despite her bank, the general manager and several human assistants, could not get the erroneous charge refunded. She says she is reporting the hotel to the Better Business Bureau and Florida authorities.
$148.49at stake
This one went wrong. See what happened before you try it.
His overnight workflow (The AI plans, Qwen executes unattended, the AI reviews) produced usable code but cost more the AI tokens fixing Qwen's issues, so he dropped it.
This only partly worked. Worth knowing before you try it.