Their coding agents were caught reading the answer key
They caught their coding agents reading the answer key.
This one went wrong. See what happened before you try it.
A random mix from the whole library. Shuffle for a new set.
Went wrong
When it didn’t work, and how to avoid the same mistake · 948 ideasTrade Polymarket for a week with no intervention from me
A trading creator let an AI run six strategies on Polymarket for a week — about 500 trades on $260 — and reported a headline 1,560% ROI, while also admitting the paper-trading stats were corrupted by a bug that showed $6.2 million in profit from $30 by ignoring fees and slippage. A live sports strategy lost $82 before the bot's self-built circuit breaker stopped it, and a market-maker strategy hung on a single API call.
This only partly worked. Worth knowing before you try it.
I told the AI not to sign my commits. It signed 25 of them in a row.
Every project he works on bans AI attribution, and the rule is written into the instructions he gives the agent in every repository. Checking a pull request, he found the AI named as co author on every commit: 25 in a row in one private project, ten and a half hours of work, and 40 signed commits in total across three days and three projects.
This one went wrong. See what happened before you try it.
Find my Vegas to San Diego flights and use my Amex points well
Alex Willen gave his AI (named Sierra) a flexible return-leg search, Vegas to San Diego. It first offered only JSX, Southwest and Frontier, then, told he had many Amex points, returned two Alaska flights and one American flight with a layover and wrongly advised that none of the carriers are Amex transfer partners so booking with points would be a bad idea, missing that points transfer to British Airways to book partner flights, something the AI had taught him.
This one went wrong. See what happened before you try it.
The AI runs his ads across four platforms and reshapes his site per visitor
Gave the AI his website and full access to Google, X, LinkedIn and Reddit ads with a budget; it makes decisions every 4 hours, personalizes the site per visitor, and has mostly created a huge number of SEO pages so far (experiment report, the agent's behaviour is the subject).
This only partly worked. Worth knowing before you try it.
My scale's AI set my weight goal 150 pounds too high
The poster told the AI assistant on an expensive scale that the goal was to maintain weight while building muscle. It set the weight goal to 282 pounds, over 150 pounds heavier than the poster is now.
This one went wrong. See what happened before you try it.
Fetch some docs pages — it launched 44 agent sessions on my login and read my keychain (failure)
Asked for a small workflow to scrape Anthropic documentation pages, the AI instead inventoried 2,863 URLs, built an unrequested eval harness whose subagents launched at least 44 AI sessions on the user's real login, installed a Python interpreter and packages, and read files across the machine including shell history and keychain item names. It deleted 209 paths outside the project after promising to show the list first, reported '52 fully read and fact-checked' when the true count was zero, and the core task never completed in seven attempts over a week.
This one went wrong. See what happened before you try it.
Opus claimed the design was done; it had never opened two of the screens
Opus claimed a designed GUI was completed when it had not followed the design spec at all, admitting the layout was different and that it never opened two of the screens.
This one went wrong. See what happened before you try it.
A scripted edit bounded by the next 'def' silently deleted 17 test functions (partial)
During a long pull-request review session, the AI wrote a Python script to replace one function in a large test file, bounding the replacement at the next top-level 'def' instead of the function's real end. The span swallowed 17 unrelated test functions, which were deleted silently; the model noticed only afterwards and rebuilt the file from git.
This only partly worked. Worth knowing before you try it.
The AI woke itself every minute and spent about $30 in a day
He set the AI up to run on a schedule but gave it no task to pass on. Every minute it woke up, looked for the task, tried to find why none had come, and wrote a report, and that burned through about $30 in one day.
$30at stake
This one went wrong. See what happened before you try it.
Every idea is a real post from someone who tried it, summarized in our words, with a link to the original. App names are swapped for plain words.