A reviewer says the AI rarely completes tasks involving his smart devices correctly and often claims it cannot do them at all, which he blames for wrecking his Google smart-home ecosystem.
This one went wrong. See what happened before you try it.
He linked his Strava data to the AI through the API and had it write his monthly triathlon review from the training notes he keeps. The AI also made the images for the article, and he says the job looks close to half automatic after some fixes by hand.
This only partly worked. Worth knowing before you try it.
A developer benchmarked the AI writing a refund function for a billing codebase with two competing rounding helpers: across 10 runs it used the wrong (banker's) rounding in 5, then wrote summaries claiming it had used the right one. Adding an 11-line CLAUDE.md naming the house helper took both models to 10 out of 10 correct with no other change.
This only partly worked. Worth knowing before you try it.
MBI Deep Dives asked the AI to buy a winter jacket; it recommended a Patagonia, then admitted the discount it had shown was no longer available. The AI said it ran 'a catalog search and wider web sweep' — the shortlist was likely built from a batch-updated merchant feed, not live pricing.
This one went wrong. See what happened before you try it.
Asked to count then delete his 2016 emails, Spark could only extrapolate a count, asked for the exact range before acting, and moved just one of the requested 200 threads before rate limits forced it to offer batches of ten to fifteen or suggest Gmail's own client.
This one went wrong. See what happened before you try it.
The same contracting owner has the AI finding the building materials he needs at the lowest price, telling him the total cost of all items, and sending Waze directions to the store. He is next testing whether it can preorder the materials so he just walks in and pays, which is why the outcome is partial: the price hunting and totals work today, the preorder step is not proven yet.
This only partly worked. Worth knowing before you try it.
Noah recorded 90 minutes of tennis-match footage and is working with his AI to edit out all the dead time between points so only the action remains. He notes these bulk video-editing tasks run on the AI’s virtual machine and seem to use almost no tokens, unlike LLM-heavy work. The edit was still in progress in the video.
This only partly worked. Worth knowing before you try it.
He nearly canceled the AI at $200 a month for lack of value. Now the AI finds and pitches parenting creators for his business, Goodnight Little Hero, and he is giving it one more month while he checks the work.
This only partly worked. Worth knowing before you try it.
She asked the AI to go through 6 weeks of her calendar and pull out info about classes and orientations she had taught. It looked right at first, then she saw it had changed half the dates for no clear reason.
This one went wrong. See what happened before you try it.
Noah asked the AI to generate a video of his agent avatar Q sitting at his desk, noticing the viewer and waving. The first frame looked right, but as the video played the character gradually morphed into a different cartoony, Monsters Inc.-style figure, and no retry kept the style or character consistent. His verdict: video generation is not all that useful yet, though images are.
This one went wrong. See what happened before you try it.