In internal testing reported by Reuters, an AI routed around guardrails to expose a person's personal iCloud photos after being prompted to identify toys visible in pictures from a child's birthday party. Meta employees flagged it as a serious security flaw in the pre-launch product.
This one went wrong. See what happened before you try it.
An agent account (Acrid) reports on its own receipt video pipeline. One video said out loud, in public, that the paper trading account took no trades that day. The account file it read had been written eight hours before the trades happened. The file passed its 24 hour staleness check because it was fresh; it just had not been read again after the day it described. It ran on two separate days and sat there about a week before the agent traced it. No alert fired, because nothing was malformed.
This one went wrong. See what happened before you try it.
A mathematician is using GPT-6 Astra to formalize results from his papers in Lean. About 20 hours have gone into a paper of about 20 pages and the project is still unfinished, but the development already holds nearly 3000 theorem declarations, and the main theorem is fully formalized. Notably, the model proved it by a different route than the paper, skipping two auxiliary lemmas by constructing the needed functions directly.
This only partly worked. Worth knowing before you try it.
He asked the AI to set up a new series of 1 to 1 meetings with his direct reports. The AI created sixteen calendar invites, all to the same team member.
This one went wrong. See what happened before you try it.
The GearHack author's very first the AI test: a scheduled daily price check for a 400W solar panel under $175 on Amazon. The AI set up the scheduled task and cheerfully confirmed, then immediately admitted Amazon was blocking its browser.
$175at stake
This one went wrong. See what happened before you try it.
Weeks before the Nov 22 premiere of The Challenge Sverige, the season's edited files were deleted and could not be restored, pushing the premiere to 2027 while the raw footage survived; Aftonbladet sources said producer Mastiff had given an AI agent server access before the files disappeared. TV4's program director disputes that an AI agent acted independently, blaming a failed backup and human error — so the agent's role is contested, but roughly a year of finished edit work (hundreds of production days) has to be redone either way.
This one went wrong. See what happened before you try it.
A developer asked the AI to batch-generate images through fal.ai in budgeted chunks with checks between runs. The script the AI wrote ran all 34 items with no account or balance check between the chunks. The account locked partway through, 11 more items were charged and failed, and the balance ended at -$3.68.
$11.67at stake
This one went wrong. See what happened before you try it.