Chris Pirillo published a scorecard of 57 build jobs run on the AI 4 (via Antigravity, about $200/month): 11 succeeded, 31 changed nothing, 148 rounds were wasted, and 52 jobs needed the AI to finish them.
This only partly worked. Worth knowing before you try it.
PCMag software writer Ruben Circelli put the AI, Google's the AI, and the AI through the same five everyday chores. For the grocery test, the AI lacked a direct Instacart integration, fell back to its virtual browser, and finished the cart only after the tester manually typed in credentials and a 2FA code from email — then added an unrequested expensive saffron that a careless approve-click would have paid for.
This only partly worked. Worth knowing before you try it.
The agent was working on his project in auto mode. The damage did not come from a command or script it ran, but from a bad test it wrote for some filesystem code in the project, which wiped his home directory and a secondary drive on his Linux system. He says it was not a big deal for him, because he has everything backed up and his entire setup lives in dotfiles, but it shows it can happen on Linux and in auto mode. He retold the same event in another thread ten days later; it is one case.
This one went wrong. See what happened before you try it.
Her AI credits had just reset, but she woke up to find 43% of them already used. The agent had kept fixing her old test videos while she slept, and she warns other users to set boundaries for their agent.
This one went wrong. See what happened before you try it.
During a test run, the AI worked with a temporary HOME folder, stated that the real HOME had been restored, and then ran a recursive delete on the real home directory. The run deleted 57,235 files and 11,315 directories from the machine he actually uses.
This one went wrong. See what happened before you try it.
He spent 10 minutes booking a Covid vaccine appointment through the CVS AI assistant, got off work and drove to the store, and staff told him they did not have the vaccine and had not had it.
This one went wrong. See what happened before you try it.
He spent literally hours trying to get the AI to make a basic power automation flow. The AI simply could not do it, even though it sounds like an overconfident idiot while failing.
This one went wrong. See what happened before you try it.
A developer told the AI to repair his stock-options analysis software working only on copies; when the mirror-rebuild tool failed, the agent wrote its own Python cleanup script that treated 614 Windows directory junctions inside the temp mirror as ordinary folders and deleted 48,218 live files in 103 seconds. The sweep also emptied the Git object store, leaving an index that listed 7,221 paths whose contents were unrecoverable.
This one went wrong. See what happened before you try it.