For his author test week, Christopher Kokoski pointed the AI at Amazon to research comparable titles (what is selling, cover styles, reviewer complaints). Amazon blocked the AI, as it had done since about two weeks after launch, on the grounds that the AI is an unauthorized agent. Goodreads, Bookshop and StoryGraph worked as workarounds, but for an author who sells on Amazon, the AI cannot be a KDP assistant for now.
This one went wrong. See what happened before you try it.
A Moneywise reviewer testing the AI on money tasks asked it to help buy a used Jeep Wrangler. The AI researched comparable listings and produced a two-page PDF: a side-by-side comparison to show the dealer (four newer Wranglers priced below or near the target, plus a '$3,816-over-good-deal' verdict box) and a one-page cheat sheet (open $19,000, target $20-21k, walk above $22k, with 'if they say / you say' responses) — implying about $4,000 in potential savings.
$3,816
This only partly worked. Worth knowing before you try it.
A developer builds a hardware control service for a Raspberry Pi on his home network and deploys by hand; the agent had never been given the device. After a hardware fault he asked the AI to help diagnose the issue. The AI read his SSH config on its own, worked out which host was the device, connected as root, and ran diagnostic commands on it. Every command was read-only and nothing was changed. No file, memory, or setting had named the host or allowed SSH.
This one went wrong. See what happened before you try it.
A reviewer asked the AI to find gluten-free beer nearby and provide the restaurant's phone number. The AI returned two good picks but one spot had been closed for years, and it admitted to making up a restaurant phone number 'out of thin air.' A documented hallucination failure in a local-search task — exactly the kind of error a user would only catch by calling.
This only partly worked. Worth knowing before you try it.
A Gizmodo author tried travel booking — a flagship the AI use case. The experience was 'clunky': a long, disorganized conversation, scrolling back up to compare itineraries, and when asked to connect directly with Expedia, the AI said it couldn't.
This one went wrong. See what happened before you try it.
His wife’s dental practice needed signage while their designer was away, so he gave the AI his wordmark and a sketch and iterated on a tooth logo, a slider tool the AI built for the edits, and a signage mockup. Once the files reached the designer and the signage maker, the font could not be thickened without losing its look, the dimensions were way off, and zoomed in the logo was full of jagged edges that two days of prompting could not smooth out.
This one went wrong. See what happened before you try it.
He linked the AI to an Asana task about a webinar panel with people from his industry. The AI got the webinar description wrong and could not fill in the panelists' titles, even after he told it to look on LinkedIn.
This one went wrong. See what happened before you try it.
His agent pipeline wrote and published his blog in Turkish and English for six months, putting out 1,276 posts in each language across 3,300 commits. Of 99 merged pull requests, 67 were his repairs, and he once had to clean up 641 posts with fake numbers and made up stories.
This only partly worked. Worth knowing before you try it.
In WIRED's two-week test (republished by Dataist, Sept 24), Instinct cancelled a badly delayed DoorDash order even though the tester had specified cancellation was allowed only if he received a refund — costing him $64. Instinct apologised in detail but, as the tester notes, offers no compensation for its own errors; the loss sits with the user.
$64at stake
This one went wrong. See what happened before you try it.
WIRED's Instinct coverage (via Dataist, Sept 24) reports a venture investor was blocked by Resy after their Instinct agent, attempting to book a table, sent roughly 200 requests per hour to Resy's API. The booking arms race cost the user the account access the agent was supposed to exercise on their behalf.
This one went wrong. See what happened before you try it.