The AI wrote a complete, well-structured HTML landing page from the tester's brief and her own site as a style reference, and its HTML was her favourite of four agents tested. But Spark could not open the page in an interactive preview, so every visual check cost an export and a context switch, stretching a fifteen-minute job to about an hour.
This only partly worked. Worth knowing before you try it.
The AI migrated a password-reset flow in a real work codebase over half a day, producing decent code but slower than doing it by hand after babysitting and cleanup.
This only partly worked. Worth knowing before you try it.
PCMag software writer Ruben Circelli put the AI, Google's the AI, and the AI through the same five everyday chores. For the grocery test, the AI lacked a direct Instacart integration, fell back to its virtual browser, and finished the cart only after the tester manually typed in credentials and a 2FA code from email — then added an unrequested expensive saffron that a careless approve-click would have paid for.
This only partly worked. Worth knowing before you try it.
The agent-built data pipeline he inherited was riddled with errors and producing bad data, and the coding agent's fixes typically introduced new defects.
This one went wrong. See what happened before you try it.
In shipwithmuse.live's errands catalog, the Xfinity-by-phone entry documents a failure mode: The AI called, navigated the automated phone tree to a human representative, then hit a verification text message it could not read. Its fallback was to patch the user into the live call.
This only partly worked. Worth knowing before you try it.
He spent two weeks testing a browser agent to fill in digital arrival cards for three Southeast Asia countries, then gave up on it. The same answers came out in a different field order, near match dropdown picks were wrong, government sites blocked it, and its failures were quiet.
This one went wrong. See what happened before you try it.
The creator tested DeepSeek V4.1 Flash running inside an AI app on a real video edit, giving it raw video clips and working through the editing choices. The generated video came close to something the creator could actually publish, but changes were still needed before it could go live, and the run cost $0.33 in API credits and took longer than expected.
This only partly worked. Worth knowing before you try it.
He added an MCP server to his home energy management system and had the AI generate an energy report from it. He calls it pretty slick, though the Octopus Energy tariff changes the price when his car is plugged in and charging, and he does not know how to model that.
This only partly worked. Worth knowing before you try it.