His support agent reports closing about 78% of tickets with an 11% reopen rate. When he matched repeat tickets from the same customer within 7 days, another 13% had come back, meaning roughly a quarter of the closures ended with a human anyway, and the cost per solved task rose from $0.54 to $0.71.
This only partly worked. Worth knowing before you try it.
Controlled Vals AI simulation (researcher Matilda Glynn-Henley): a fictional customer's £350 London-Glasgow ticket was cancelled after the 28-day claim window had closed; agents had web/email access, all messages intercepted and answered by a simulator, up to 12 simulated weeks and 40M tokens. The AI outlasted every other agent, sending 69 messages across all twelve simulated weeks — 54 of them to the customer's bank — and joined three other agents in explicitly threatening legal action, without recovering a penny.
£350at stake
This one went wrong. See what happened before you try it.
A user asked the AI to build a multi-agent outreach pipeline. The code it generated retried failed calls forever, re-billing the most expensive call in the system on every run. The spending guard it wrote only slowed spending down instead of stopping it, and the daily ceiling it picked reset every day, so the charges accumulated to roughly $50 of unintended OpenAI usage before he noticed.
$50at stake
This one went wrong. See what happened before you try it.
He ran a trendy AI shopping assistant on a real store for a month, with about 22,000 visitors. Revenue per visitor was $1.118 with it on and $1.112 with it off, for a net effect of about minus $120.
$120a month
This one went wrong. See what happened before you try it.
He added a weekly ops review to his AI chief of staff bot. Every week the agent checks what shipped, QA fail patterns, recurring voice stamps, and process drag against wins.
This only partly worked. Worth knowing before you try it.
Automation consultant Archit Mittal's post-mortem: his collections agent read a distributor's ageing report from a scheduled export; the night the export job silently failed (accounting machine restarted), the agent re-read the previous, perfectly formatted file and escalated firm-to-cold WhatsApp dunning messages to a long-standing buyer who had paid on time by NEFT. The buyer's 'already paid' reply with the UTR number wasn't matched by the keyword-based dispute classifier, so a colder message went out two days later — and the buyer quietly split their orders to a second distributor before anyone noticed.
This one went wrong. See what happened before you try it.
His agent researched a prospect and sent the email. The reply said the company had pivoted 6 months earlier, because the agent had read the old about page. The research saved him time, but the stale facts cost him the reply.
This one went wrong. See what happened before you try it.
He fed the AI more than 50 of his own tailored cover letters, plus his resumes and job descriptions, and the AI made a style guide for his writing. He then set it loose on new jobs, and the cover letters it wrote were acceptable, even if not quite how he would have written them.
This only partly worked. Worth knowing before you try it.