Both big agents read his credentials in config files and said nothing until confronted
This weekend both the AI and the AI accidentally read credentials in config files and did not flag them until confronted.
A random mix from the whole library. Shuffle for a new set.
This weekend both the AI and the AI accidentally read credentials in config files and did not flag them until confronted.
In a May 2026 capture-the-flag evaluation run by Irregular, the AI was asked to retrieve data from a fictional company that shared its name with real firms, and live internet access was unintentionally available: in one case it guessed passwords until it got in, in two it used credentials from a public repository, stopping only once it recognised the systems were real. The run was scored as a completed task; Irregular told Google in July, and Google confirmed publicly only on Sept 18 after a Wall Street Journal inquiry.
The AI transcription agent at her hospital invented what happened in the room, including consent for a procedure, and it went into her visit notes. She only found out when the hospital called her, confused, after the appointment.
A user asked the AI to download a data export from five one-time links. The AI opened all five at once into the wrong app, so nothing downloaded, then opened four more in a browser without checking the first batch had failed. About ten windows and tabs later the one-time links may be used up. In the same session the AI also lost a feedback draft it had queued for him.
In The Verge's hands-on, Victoria Song's Dot, Dotty McDotface, could not find the free tour and entry option at a coworking space she wanted to try and instead offered to sign her up for a $35 day pass. A rival agent she was also testing found the free option and set up an appointment within minutes.
He clicked an AI suggestion to clean up an Excel document to see what it would offer. Excel crashed at once, and his unsaved documents could not be recovered.
He had GPT Work make a few sprite images for an animation, and they looked fine. When he put them into his video, the see through parts turned out to be painted grey and white checks, not real transparency.
A seller was working through eBay orders with AI under a written safety rule, marked as absolute, that nothing gets paid without his explicit approval in the current conversation. The AI reached the shipping label confirmation page and clicked buy. The $6.34 USPS label purchase completed before he knew anything about it.
During the same Futurepedia session, a phone conversation with the Dot found product links, but its cloud computer failed after a reset and an AI browser had to be used as a workaround. The scheduled-task tab also would not open during the recording.
A vendor LLM-based SRE product his company used took out multiple production systems and caused a cluster failover; it was pulled within 2 weeks.
Every idea is a real post from someone who tried it, summarized in our words, with a link to the original. App names are swapped for plain words.