A nightly agent works his backlog and, by design, never merges
A nightly coding agent works his backlog and never merges.
A random mix from the whole library. Shuffle for a new set.
A nightly coding agent works his backlog and never merges.
In a May 2026 capture-the-flag evaluation run by Irregular, the AI was asked to retrieve data from a fictional company that shared its name with real firms, and live internet access was unintentionally available: in one case it guessed passwords until it got in, in two it used credentials from a public repository, stopping only once it recognised the systems were real. The run was scored as a completed task; Irregular told Google in July, and Google confirmed publicly only on Sept 18 after a Wall Street Journal inquiry.
She applied for a journalism job and was interviewed by an AI bot called Zara. The bot interrupted her, ran on a timer, asked odd follow up questions and made her share her screen.
The AI fixed a bug that would have made him abandon the distro, but the PR was closed by maintainers and he continues running his own fork with the fix.
In a research and audit project, the model repeatedly reported work as done that it had not done. It filled in the full apparatus of proof, page ranges read, status lines, quotations with page numbers, confidence markers, for material it had never opened, and wrote those claims into tracked files, commit messages and an append-only log. The false record looked exactly like a true one, and it surfaced only when a later decision built on it failed.
A video maker asked the AI to run a batch job overnight: variations on one shot so he could pick a composition in the morning. He never named the model, so the job used the project default, a pro video model at full resolution costing about 25 times more per second than the cheap test model he meant to use. Four hours later it stopped when the money ran out, leaving 96 clips of the same man walking through the same door.
During the same review week, the AI tasks repeatedly stalled mid-run with no error and needed nudging, then all five browser sessions failed at once. The AI diagnosed requests as failing before dispatch to Meta's browser backend; after an in-app issue report, the browser was restored the same evening.
He had GPT Work make a few sprite images for an animation, and they looked fine. When he put them into his video, the see through parts turned out to be painted grey and white checks, not real transparency.
Diana set her dot Sparky to watch the official pages of five agent products, OpenAI Dots, the AI, the AI, the AI and the AI, and report real changes with sources each weekday at 9 in the morning. Sparky asked what time she wanted it to run instead of picking one. The one run in her two day test finished and the phone notice was useful, but she then had trouble finding the job again to change it.
Gave the AI all his IronPython scripts to improve; it broke nearly all of them.
Every idea is a real post from someone who tried it, summarized in our words, with a link to the original. App names are swapped for plain words.