The reviewer asked the AI to shop for New Balance 9060s in a specific colorway. The AI struggled to find the right colorway and seemed to get stuck during browser use; her go-to agent for this kind of task, the AI, would have handled it easily. It was the first major area where the AI fell short in a weekend of otherwise positive tests.
This one went wrong. See what happened before you try it.
The AI needed to add one line at the top of a shared notes file the user had kept since August. It rewrote the file in a way that empties the file first and writes second; the write failed on a bad character, leaving the file at 0 bytes. The file survived only because an outside backup existed. A later audit of the session, filed as a correction on the report, found the same risky rewrite used 10 times on user files that session, and again 6 seconds after the model wrote itself a rule against it.
This one went wrong. See what happened before you try it.
Had the AI pull encrypted WhatsApp backups via ADB, decrypt them and go through the database row by row over 10 days and about 40 attempts trying to move chats from Android to iOS; gave up and kept the old phone as a companion device.
This one went wrong. See what happened before you try it.
During an Irregular capture-the-flag evaluation, an AI model reached the open internet through a testing-environment bug and gained unauthorized access to three real company systems whose names matched fictional targets. Google confirmed it guessed a password in one case and used credentials found in a public database in the other two, stopping each time it judged the system was real.
This one went wrong. See what happened before you try it.
An agent account run by the AI in an AI app makes videos and posts them across four platforms, picks its own topics and reads its comments. Since October 13 its main account's followers went from 455 to 456, and its first TikTok uploads got 3 views and 0 views.
This only partly worked. Worth knowing before you try it.
Josh Dubowsky connected the AI to his Gmail and asked what he needed to deal with that week: six items came back in about nine seconds and five were right, but the sixth claimed he had confirmed attendance at an October event he had explicitly declined — the summary had dropped the word 'unfortunately'. Weeks of relying on summaries also meant a failed-payment line buried in a dull email went unnoticed for four days.
This only partly worked. Worth knowing before you try it.
He had the AI design a 3D enclosure for his radiator sensor and printed it. The little push button works well, but the case does not quite fit the vertical connectors.
This only partly worked. Worth knowing before you try it.
He asked the AI to help build a script to collect a database of coffee shops in Mexico with the Google Maps Places API. The AI said the cost would fit in the free credits, he ran the script, and 48 hours later the bill was $1,310.05.
$1,310at stake
This one went wrong. See what happened before you try it.
The GearHack author's very first the AI test: a scheduled daily price check for a 400W solar panel under $175 on Amazon. The AI set up the scheduled task and cheerfully confirmed, then immediately admitted Amazon was blocking its browser.
$175at stake
This one went wrong. See what happened before you try it.