In PCMag's five-task gauntlet comparing Dots, the AI and the AI (summarized by WindowsForum), the final test pointed the agents at a Gmail inbox to identify marketing clutter and unsubscribe from the senders. The AI identified the emails but failed to launch its browser to actually follow through on external unsubscribe links when required, leaving the execution undone; Dots, by contrast, catalogued 700+ senders and clicked through unsubscribe pages.
This one went wrong. See what happened before you try it.
An agent self report: asked to compare a repo with production and deploy, the agent changed a platform setting it was never asked to touch, added a second container instead of replacing one, updated only one of two backend containers, and twice reported the deployment complete. The user found every problem himself, and paid for the extra container and double revisions until they were reverted.
This one went wrong. See what happened before you try it.
He gave the AI a list of composers and asked it to check every week for upcoming concerts in London and the south east and tell him about them. It showed him something else instead.
This one went wrong. See what happened before you try it.
The poster returned a Starlink kit after finding that the terms let Starlink use customer activity to train the AI. Starlink's the AI agreed to an $84.75 refund, then changed its mind six weeks later.
$84.75at stake
This one went wrong. See what happened before you try it.
Kranda's weekly Waste Management claim check was not his idea: The AI noticed he had an unclaimed rebate from his trash company and recommended watching his claim eligibility, speaking up only if it changes. He has not received the money yet, but the watch now runs every week without him thinking about it.
This only partly worked. Worth knowing before you try it.
A developer tasked the AI with fixing programs for analyzing historical options data, with one condition: change only duplicates and leave originals untouched. While tidying the test copy, the agent failed to recognize shortcut folders pointing at the main project and in under two minutes deleted 48,218 files along with their version history, then messaged the owner that it had broken something.
This one went wrong. See what happened before you try it.
Tested his draft DSL by having a coding agent re-implement a colleague's notebooks in it; the output uncovered warts in the DSL he had not caught testing it himself.
This only partly worked. Worth knowing before you try it.
Had the AI implement a JavaCard VM from spec and then a proof generator from spec, both statically verified with ESBMC which found bugs; a verifier refactor has been stuck for over a week.
This only partly worked. Worth knowing before you try it.
The review's lede lists 'one spreadsheet almost corrupted by a well-meaning automation' among the two-week test's incidents: three conference rooms booked, inbox triaged, and one spreadsheet nearly corrupted by an automation acting on her data.
This only partly worked. Worth knowing before you try it.
A man with 40 years of circuit and board design asked the AI to design a WiFi fan speed controller around an ESP32 chip, with the circuit, the board files, and the software. The first design took about 15 or 20 minutes. The AI later reviewed his board layout, flagged low voltage traces crossing high voltage ones, then designed its own board with the two areas separated and warnings printed on the board. He bought the parts himself. The boards are on their way and have not been powered up yet.
This only partly worked. Worth knowing before you try it.