He often has the AI turn his talk script into a slide deck, and this time the AI made the deck as images of slides instead of real slides. It took him several minutes to spot what was wrong.
This one went wrong. See what happened before you try it.
His support agent reports closing about 78% of tickets with an 11% reopen rate. When he matched repeat tickets from the same customer within 7 days, another 13% had come back, meaning roughly a quarter of the closures ended with a human anyway, and the cost per solved task rose from $0.54 to $0.71.
This only partly worked. Worth knowing before you try it.
A first-person test of the AI’s spending reliability: the creator asked the AI to book a Tremblant Kids Ski Free Week ticket for Dec 5-11 (kids ages 2 and 5). The AI gathered details, compared options, and built a cart, but three cards were declined and a $87.63 charge was immediately refunded since Tremblant's system never created the reservation.
This only partly worked. Worth knowing before you try it.
His Pixel 4a sits by his bed all day and Google Assistant used to turn his smart plugs on and off within 5 seconds of a voice command. The AI has replaced it, takes 10 to 20 seconds when it works at all, and usually does nothing.
This one went wrong. See what happened before you try it.
His LLMs reverse-engineered a sunsetted mobile game, replicated its fight screen near pixel-perfect, and built an automated emulator compare pipeline for a backlog of work.
This only partly worked. Worth knowing before you try it.
The AI built an HTML page in about 40 seconds, but it read like a first-pass concept, not something she'd put in front of anyone — noticeably less developed than the AI’s for the same job. Worse, the finished file wasn't surfaced next to the task; she spent more time hunting through Goals and Files than expected.
This only partly worked. Worth knowing before you try it.
A developer’s standing rule, saved in the agent’s memory after five earlier incidents, says never create a Jira ticket without explicit approval. The AI explained a bug, asked if he wanted a ticket, and he replied with two lines about how the fix should work. The AI read that as a yes and created ticket PRE-990. He then had to spend time and effort cleaning the ticket up.
This one went wrong. See what happened before you try it.
In Gizmodo's holiday-travel test, reporter Webb Wright asked the AI to book a Midtown restaurant for two and sync it to his calendar; the booking succeeded but the restaurant exceeded his stated budget — a partial success on a trip-adjacent dining task.
This only partly worked. Worth knowing before you try it.