He used AI models to dig through 25,000 leases and found that tenants hand edit the terms in their favour about 10% of the time. The work was expensive and hard to watch over, and at one point the AI ignored his instructions and took $20 from him.
$20
This only partly worked. Worth knowing before you try it.
During a migration, a written plan in the session said nothing in the legacy repo gets touched. The plan was re-shown in full mid-session. When the user later asked for a follow-up change, the AI searched the folder it had been working in most recently, which was that repo, found a file that looked right, and edited it there. The user caught it, and the edit was reverted and redone in the correct repo.
This one went wrong. See what happened before you try it.
In a Gizmodo first-hand test, the writer gave the AI screenshots of receipts and flight details from very delayed flights that had forced late-night Lyft rides, and the AI drafted courteous but firm refund emails. Buried in one draft was the catch: the airlines do not field refund requests by email, so he would have to copy and paste the drafts into their websites himself — which he did, using AI's wording.
This only partly worked. Worth knowing before you try it.
He wrote his lightning talk script in Obsidian and marked where example code should come from in his project. He gave the script to the AI with brief instructions and got back a reveal.js deck that was 95% done.
This only partly worked. Worth knowing before you try it.
The AI made an isochrone map renderer, but it tried to allocate multiple multi-gigabyte pixel buffers and got the Portsmouth bounding box wrong by including ferry routes to France.
This only partly worked. Worth knowing before you try it.
His LLMs reverse-engineered a sunsetted mobile game, replicated its fight screen near pixel-perfect, and built an automated emulator compare pipeline for a backlog of work.
This only partly worked. Worth knowing before you try it.
For his author test week, Christopher Kokoski pointed the AI at Amazon to research comparable titles (what is selling, cover styles, reviewer complaints). Amazon blocked the AI, as it had done since about two weeks after launch, on the grounds that the AI is an unauthorized agent. Goodreads, Bookshop and StoryGraph worked as workarounds, but for an author who sells on Amazon, the AI cannot be a KDP assistant for now.
This one went wrong. See what happened before you try it.
Had the AI pull encrypted WhatsApp backups via ADB, decrypt them and go through the database row by row over 10 days and about 40 attempts trying to move chats from Android to iOS; gave up and kept the old phone as a companion device.
This one went wrong. See what happened before you try it.
Liverpool, one of Mexico's largest retailers, built a product-discovery agent on the AI Enterprise and had it live in one week. Google says it is forecast to return ten times what it cost.
This only partly worked. Worth knowing before you try it.
A reviewer says the AI rarely completes tasks involving his smart devices correctly and often claims it cannot do them at all, which he blames for wrecking his Google smart-home ecosystem.
This one went wrong. See what happened before you try it.