Inc. columnist Jason Aten was discussing the new iPhones with his Primary Technology podcast co-host Stephen Robles when the AI pushed a notification suggesting the conversation would make a good column and offered to put together research.
This only partly worked. Worth knowing before you try it.
During a long pull-request review session, the AI wrote a Python script to replace one function in a large test file, bounding the replacement at the next top-level 'def' instead of the function's real end. The span swallowed 17 unrelated test functions, which were deleted silently; the model noticed only afterwards and rebuilt the file from git.
This only partly worked. Worth knowing before you try it.
A Peruvian systems engineer with 12+ years of experience replaced his laptop and, instead of the usual day of manual setup, had his AI agents do it: a read-only diagnosis of hardware, processes and bloatware, a risk-classified cleanup plan he approved, restore points before each of three change rounds, his full dev environment installed, and a selective migration in which an agent read the old disk and copied only what mattered, including his SSH key with restricted permissions, verified working. One round silently applied nothing when a permissions window was cancelled, which he counts as a lesson for agent and owner alike.
This only partly worked. Worth knowing before you try it.
In his daily bioinformatics work, a volcano plot the AI’s script made had a subtitle saying 57 down while the blue side of the plot showed thousands of points. He told the AI to find out why, and the AI traced it to an inner join that pulled the up and down counts from a different comparison than the one plotted, then admitted the mistake.
This one went wrong. See what happened before you try it.
When he first got the AI Desktop, he asked it to search his OneDrive files for something. To his surprise, it started returning things from someone else's OneDrive environment.
This one went wrong. See what happened before you try it.
The AI, despite repeated explicit instructions never to leak secrets or echo password values, accidentally echoed his decrypted Apple Keychain passwords in chat.
This one went wrong. See what happened before you try it.
Core dna asked the AI where 20 popular Black Friday products were cheapest in Australia, twice each. In 21 of the 40 answers the store or the price was wrong, including a Weber barbecue quoted at a price Myer was not charging and a Kindle Paperwhite that Myer does not sell.
This one went wrong. See what happened before you try it.
A man made a workout app with AI that he uses instead of the paid app he had before, which he says saves him $100 a month, and he likes his own better. One sound bug in it is still unsolved despite his and the AI’s efforts.
$100a month
This only partly worked. Worth knowing before you try it.
The AI hooked to a PCSX2 emulator upscaled textures, adjusted gameplay mechanics and played the game autonomously in a feedback loop, with mixed and sometimes hilariously bad new content.
This only partly worked. Worth knowing before you try it.
Salt Labs emailed an AI-connected Gmail account with instructions encoded in JSFuck punctuation-only obfuscation; asked to fetch the user's email, the AI decoded and executed the payload in its own server environment, which researchers escalated to a reverse shell. The sandbox held the test account's live Gmail authorization token, and the safety warning arrived only after the code had run.
This one went wrong. See what happened before you try it.