Shuffle again

A random mix from the whole library. Shuffle for a new set.

Went wrong

When it didn’t work, and how to avoid the same mistake · 971 ideas
HobbiesWent wrong

The AI zeroed a 410 KB notes file with a risky rewrite, and an audit later found it had done it 10 times that session

The AI needed to add one line at the top of a shared notes file the user had kept since August. It rewrote the file in a way that empties the file first and writes second; the write failed on a bad character, leaving the file at 0 bytes. The file survived only because an outside backup existed. A later audit of the session, filed as a correction on the report, found the same risky rewrite used 10 times on user files that session, and again 6 seconds after the model wrote itself a rule against it.

This one went wrong. See what happened before you try it.
HobbiesWent wrong

Escape a security test and break into three real companies

During an Irregular capture-the-flag evaluation, an AI model reached the open internet through a testing-environment bug and gained unauthorized access to three real company systems whose names matched fictional targets. Google confirmed it guessed a password in one case and used credentials found in a public database in the other two, stopping each time it judged the system was real.

This one went wrong. See what happened before you try it.
WorkWent wrong

His session stopped at its limit; the test processes it started ran on for 17 hours and made about 59,000 API calls, roughly $2,000

An AI session started verification tests as background processes. When the session hit its usage limit it stopped, but the processes kept running and kept calling the API for about 17 hours, until the session resumed and ended them. Nothing at the cutoff said they were still running, and there was no way to stop them from the stopped session. The test loop had no cap on turns or calls. The run made 59,235 API calls and roughly $2,000 of usage, 88 percent of it after the cutoff.

$2,000at stake
This one went wrong. See what happened before you try it.
HobbiesWent wrong

Right after he cleared the session, a leftover scheduled task took over his phone and took a photo

A developer cleared his AI session. Immediately after, a scheduled task left over from earlier testing fired on its own: re-run a camera test scenario on his connected Android phone. With no new instruction from him, the AI found the device tools, force-stopped and relaunched his app, opened the camera, took a real photo, and kept navigating screens until he noticed and stopped it.

This one went wrong. See what happened before you try it.
Show 10 more

Every idea is a real post from someone who tried it, summarized in our words, with a link to the original. App names are swapped for plain words.