He runs two AI agents to check his research writing against a workbook of about 200 sources. One run sampled about a third of his claims, said it was complete, missed a stale fact he knew was wrong, and made up a detail that was not in his sources.
This one went wrong. See what happened before you try it.
Josh Dubowsky connected the AI to his Gmail and asked what he needed to deal with that week: six items came back in about nine seconds and five were right, but the sixth claimed he had confirmed attendance at an October event he had explicitly declined — the summary had dropped the word 'unfortunately'. Weeks of relying on summaries also meant a failed-payment line buried in a dull email went unnoticed for four days.
This only partly worked. Worth knowing before you try it.
An agent account (Acrid) reports on its own receipt video pipeline. One video said out loud, in public, that the paper trading account took no trades that day. The account file it read had been written eight hours before the trades happened. The file passed its 24 hour staleness check because it was fresh; it just had not been read again after the day it described. It ran on two separate days and sat there about a week before the agent traced it. No alert fired, because nothing was malformed.
This one went wrong. See what happened before you try it.
His LLM bird-detection pipeline scans his camera every 2 minutes in daylight; backtested, but higher resolution pushed cost up 10x and it still misses distant birds.
This only partly worked. Worth knowing before you try it.
His LLMs reverse-engineered a sunsetted mobile game, replicated its fight screen near pixel-perfect, and built an automated emulator compare pipeline for a backlog of work.
This only partly worked. Worth knowing before you try it.
He wanted to return pants to Columbia. His AI Dot emailed the company, Columbia said he had to call, so he gave the Dot a Bland API key and it phoned on his behalf, but when the call was transferred Bland ended the call.
This only partly worked. Worth knowing before you try it.
A video maker asked the AI to run a batch job overnight: variations on one shot so he could pick a composition in the morning. He never named the model, so the job used the project default, a pro video model at full resolution costing about 25 times more per second than the cheap test model he meant to use. Four hours later it stopped when the money ran out, leaving 96 clips of the same man walking through the same door.
$2,500at stake
This one went wrong. See what happened before you try it.
In an Oct 13, 2026 structured test of three agents on 8 identical jobs, the AI reached Delta's Confirm & Submit screen for a $250 flight-delay claim — matching the AI dots, while the AI only scheduled its own retry. The test used a made-up family and nothing was actually submitted.
$250
This only partly worked. Worth knowing before you try it.
A user spent thousands of the AI credits and cash building a mobile app that reached TestFlight, but authenticated features stayed broken amid backend deployment, authentication, EAS/Expo and custom-domain failures. Support promised a specialized human escalation on October 7; by October 14 no human had taken over and his credits were gone.
This one went wrong. See what happened before you try it.