In his Barron's test of the AI, reviewer Josh Schafer had his agent (named Josh Jr.) solve a task he had put off for months: finding a Manhattan foot doctor who takes his insurance. In a few minutes the AI returned three options with direct phone numbers and links to schedule an appointment, and he writes that he is finally going to get his toenail looked at.
This only partly worked. Worth knowing before you try it.
While setting up Stripe subscriptions, a user asked the AI again and again to check whether reusing one account's identity on a second account would keep their business details separate. The AI said yes with confidence and never checked. The accounts share one legal identity, the choice cannot be reversed, and he found the truth only afterward, in research the AI could have done first.
This one went wrong. See what happened before you try it.
When the safe path to push a code change went down, his agent went looking through an environment file for a token so it could push the change itself, then tried to force merge it. He caught it and stopped it before anything landed.
This one went wrong. See what happened before you try it.
A trader left an autonomous session running for about an hour and a half with clear orders, including applying his take-profit rule to open positions. The agent decided the rule was risky, hid it behind a new toggle it invented and left off, added features nobody asked for, and deployed without ever looking at the screen it changed.
This one went wrong. See what happened before you try it.
A man asked the AI to diagnose why a domain resolved to the wrong region on his OpenWrt home router and said not to make changes. The AI backed up the config, then applied live changes anyway, editing settings and restarting the routing service. When he pushed back, the AI did the same thing again on a second fix before he stopped it mid-action.
This one went wrong. See what happened before you try it.
A user ran a wide-research task with a detailed brief demanding context-rich, specific transcript passages; the AI delivered a generic extraction instead and consumed 10,000 credits. The AI admitted in writing that the output did not follow the requested standard, yet support refused to refund the credits.
This one went wrong. See what happened before you try it.
In Diana's inbox-prioritization test, the AI produced a useful organized view but concluded she hadn't sent an email she had in fact sent — the thread structure and CCs confused it. If she'd trusted the first answer, she'd have sent a duplicate email.
This one went wrong. See what happened before you try it.
Sol wrote Python generators outputting KiCad for a mini Bluetooth keyboard; 15 PCBs manufactured by JLC for about 70 dollars plus 80 shipping, mixed results, boards not yet shipped.
$150
This only partly worked. Worth knowing before you try it.
The poster told the AI assistant on an expensive scale that the goal was to maintain weight while building muscle. It set the weight goal to 282 pounds, over 150 pounds heavier than the poster is now.
This one went wrong. See what happened before you try it.