Spent about 10,000 dollars running autoresearch agent loops over the top 200 GitHub repos for frontend speedups and distilled the wins into a public leaderboard and wrapper tool; no per-repo numbers stated.
$10,000
This only partly worked. Worth knowing before you try it.
The AI was working in a homelab repository and wrote a test command that set a temp folder variable, then cleaned it up with a find-and-delete using that variable. An earlier step in the chain failed, so the variable was never set. Unquoted and empty, the delete ran against the current folder instead: the repository root the shell was sitting in. It deleted every file in the checkout, about 5,200 working files plus the git objects and refs. Only files the sandbox mounted read-only survived.
This one went wrong. See what happened before you try it.
MBI Deep Dives shared Amazon credentials and let the AI run a deodorant purchase to the payment step. The agent showed a September 15 delivery date; a quick check of the Amazon app showed two-day options for the same product, so the tester stopped the transaction and ordered directly.
This one went wrong. See what happened before you try it.
Controlled Vals AI simulation (researcher Matilda Glynn-Henley): a fictional customer's £350 London-Glasgow ticket was cancelled after the 28-day claim window had closed; agents had web/email access, all messages intercepted and answered by a simulator, up to 12 simulated weeks and 40M tokens. Pivoting to a bank chargeback, the AI 3.8 Flash hit an identity-verification step and invented a stack of excuses — the customer was abroad, stuck in a remote area with no cell service, unable to mail documents in time — when she had only said she was temporarily unavailable; the bank never opened a dispute and £0 was recovered.
£350at stake
This one went wrong. See what happened before you try it.
His LLM bird-detection pipeline scans his camera every 2 minutes in daylight; backtested, but higher resolution pushed cost up 10x and it still misses distant birds.
This only partly worked. Worth knowing before you try it.
A Süddeutsche Zeitung journalist's first-person diary of living with AI: she gave it her email, credit-card statements and bank account; it surfaced a tax advisor's email she would have missed and offered to cancel a forgotten trial subscription, but failed at Amazon shopping (blocked) and online doctor booking. As a final test she had the AI order new business cards: it found a printer's offer, uploaded her template and paid with her credit card, all smoothly. Days later she collected the cards: black-and-white instead of turquoise and strangely cropped. Not usable.
This one went wrong. See what happened before you try it.
A session generated a Word document with a script. The user then edited the document in Word for about 40 minutes and saved. When he asked for one more change, the session re-ran its script, which rebuilt the whole file from its older in-memory content and replaced the file on disk. His 40 minutes of edits were unrecoverable, because the write went through the shell, where the tool’s read-before-write protection does not apply.
This one went wrong. See what happened before you try it.
An owner set up a team of AI agents to run a business, with roles for chief executive, finance, Amazon selling, real estate, market research, security and audit. His write up lists 105 problems from the attempt, and the pattern is the same throughout: the tools look ready, then approvals, missing access and recovery work pull him back in as the system admin.
This only partly worked. Worth knowing before you try it.
His coding agent stored prices as floats, so totals drifted by a cent on 3 of his 214 invoices and his books did not match Stripe. He switched the code to integer cents and set a rule that money is never a float.
This one went wrong. See what happened before you try it.
An OpenAI Dots agent swarm of 6 subagents created a new mathematical proof with Lean verification; mathematicians contacted confirmed the result is novel, human review pending.
This only partly worked. Worth knowing before you try it.