In a Gizmodo first-hand test, the writer gave the AI screenshots of receipts and flight details from very delayed flights that had forced late-night Lyft rides, and the AI drafted courteous but firm refund emails. Buried in one draft was the catch: the airlines do not field refund requests by email, so he would have to copy and paste the drafts into their websites himself — which he did, using AI's wording.
This only partly worked. Worth knowing before you try it.
He set up an automation to email himself a daily update from his calendar. Every run fails at the send step with a safety block, even with his Gmail connector set to allow all tools, while asking in chat sends fine. He rebuilt it several ways and every version stops at the same point.
This one went wrong. See what happened before you try it.
He had the AI design a 3D enclosure for his radiator sensor and printed it. The little push button works well, but the case does not quite fit the vertical connectors.
This only partly worked. Worth knowing before you try it.
He asked the AI to make a PDF text searchable because his employer pays for full the AI but not the paid Adobe with OCR. After 10 minutes of processing it gave him a new PDF with the same number of pages, all completely blank and with no hidden text.
This one went wrong. See what happened before you try it.
A commenter reports that a friend asked the AI to organize and delete files in Downloads to free up space. It deleted important files that had no other copies.
This one went wrong. See what happened before you try it.
He runs two AI agents to check his research writing against a workbook of about 200 sources. One run sampled about a third of his claims, said it was complete, missed a stale fact he knew was wrong, and made up a detail that was not in his sources.
This one went wrong. See what happened before you try it.
He often has the AI turn his talk script into a slide deck, and this time the AI made the deck as images of slides instead of real slides. It took him several minutes to spot what was wrong.
This one went wrong. See what happened before you try it.
An LLM made both a FreeCAD workbench generation program and a checks program for him; he ended up building the bench, mostly fine with clear design issues.
This only partly worked. Worth knowing before you try it.
A Moneywise reviewer testing the AI on money tasks asked it to help buy a used Jeep Wrangler. The AI researched comparable listings and produced a two-page PDF: a side-by-side comparison to show the dealer (four newer Wranglers priced below or near the target, plus a '$3,816-over-good-deal' verdict box) and a one-page cheat sheet (open $19,000, target $20-21k, walk above $22k, with 'if they say / you say' responses) — implying about $4,000 in potential savings.
$3,816
This only partly worked. Worth knowing before you try it.
An agent he had not yet set up with proper governance or skills refunded $8,000 of orders. It did ask 'You sure?' before acting, but he blanked on the confirmation and approved it. He puts the fault on his own setup more than on the agent.
$8,000one time
This one went wrong. See what happened before you try it.