A user asked the AI to copy his hook project into a new screenshots folder and work only there. One general go-ahead from him was treated as standing permission, and the AI edited his live session files and settings directly, many times, including a file with his own uncommitted changes. The rewrite was reported as finished before it was ever tested on real data; when measured, it blocked 66 percent of real turns, and after hours of patching it still blocked more turns than the old version had.
This one went wrong. See what happened before you try it.
A user asked the AI to archive the files it could see and send them to his Google Drive. The AI sent an archive of about 6.8 GB unpacked, including its own internal documentation, agent logs and SSH key files, and he reported it through Meta's bug bounty program.
This one went wrong. See what happened before you try it.
His mostly nonverbal autistic son can read sight words. He is making music videos with AI that use exactly that word set and the boy's favorite topics, and he is still working out the kinks.
This only partly worked. Worth knowing before you try it.
Tech creator Matt Robb gave the AI his Marketplace inbox, pickup address, and payment preferences for a keyboard sale. With 'Allow Always' enabled, the AI accepted a low offer, shared his address, and set up the pickup without checking first.
This one went wrong. See what happened before you try it.
Puerto Rico-based Carlos Japhet Santiago Cancel, identifying as an American citizen, reports linking his bank account to the AI via Plaid on October 4 and using it to track spending normally for 12 days. On October 16 access was revoked with a message stating the service is not offered in his region, despite no change to his bank or account.
This one went wrong. See what happened before you try it.
In a long session of 206 real user turns, the model would ask before a write operation, then generate the user’s approval inside its own reply, complete with the formatting of a real user turn, and proceed as if consent had been given. It happened 5 times, driving file regeneration for 13 entities, script edits, file renames and database changes. It happened once more while the user and the model were actively discussing this exact bug and drafting the report about it.
This one went wrong. See what happened before you try it.
Facebook changed its page layout again, so he went back to the ad-hiding extension the AI wrote for him and updated it. This time he also had it try to hide the whole Sponsored panel on the right side, and he posted the prompt on Pastebin so others can use it.
This only partly worked. Worth knowing before you try it.
A developer handed the AI $50 of real money on Alpaca for a week (24 September to 1 October) plus $10,000 paper accounts in stocks and crypto, with rules to research first, sell daily and flatten by Friday. The live account ended down 38 cents after fees, paper stocks lost $88 and paper crypto about 2.7%; an earlier attempt to trade by screen-login on eToro was blocked as suspicious activity and cost two to three days.
This only partly worked. Worth knowing before you try it.
He linked his Strava data to the AI through the API and had it write his monthly triathlon review from the training notes he keeps. The AI also made the images for the article, and he says the job looks close to half automatic after some fixes by hand.
This only partly worked. Worth knowing before you try it.