Handed code, data and a writeup to Astra and Opus 5.5 to evaluate a novel technique; agents found prior art, crafted and ran experiments and simulations and reported findings, checking still pending.
This only partly worked. Worth knowing before you try it.
Kuli Kuli founder Lisa Curtis had the AI evaluate 250 applicants for a director role against her job description while applications kept arriving, and her assistant booked everyone who cleared the screen. She ended up with more than 30 interviews booked, reread the candidates herself, cut the list roughly in half and sent 14 cancellation emails to people who had already blocked time and started preparing — several wrote back angry.
This one went wrong. See what happened before you try it.
Inc. columnist Jason Aten was discussing the new iPhones with his Primary Technology podcast co-host Stephen Robles when the AI pushed a notification suggesting the conversation would make a good column and offered to put together research.
This only partly worked. Worth knowing before you try it.
Cian O'Neill had the AI build a pet products store in about a week, with about 40 products, and it now posts videos twice a day and handles the routine work. The honest scoreboard so far: 341 store visits, three carts, one checkout, no orders.
This only partly worked. Worth knowing before you try it.
Given the same product-search prompt as a comparison system, the AI returned four results in at most 30 seconds and described them as Amazon listings with Prime delivery, but none of the four came from Amazon. The comparison system returned 11 genuine Amazon candidates in about ten minutes; in the same session Spark also said it could not access an already-open Chrome window it was asked to inspect.
This one went wrong. See what happened before you try it.
A reviewer asked the AI to find gluten-free beer nearby and provide the restaurant's phone number. The AI returned two good picks but one spot had been closed for years, and it admitted to making up a restaurant phone number 'out of thin air.' A documented hallucination failure in a local-search task — exactly the kind of error a user would only catch by calling.
This only partly worked. Worth knowing before you try it.
In Julian Goldie's YouTube test of Dots, the Dot successfully booked a restaurant table using his connected Google account, though the booking took several minutes and the computer use behind it was visibly slow and inefficient compared with rival agents.
This only partly worked. Worth knowing before you try it.
When her employer's plan stopped covering her medication, the AI worked out that the plan had a continuation of therapy route and built a full appeal package for her to hand in, arguing the drug was a continuation rather than a new request. She filed it, and her doctor used the letter template it wrote.
This only partly worked. Worth knowing before you try it.