Shuffle again

A random mix from the whole library. Shuffle for a new set.

Went wrong

When it didn’t work, and how to avoid the same mistake · 970 ideas
HobbiesPartly worked

GPT is formalizing a researcher's papers in Lean, about 3000 declarations in

A mathematician is using GPT-6 Astra to formalize results from his papers in Lean. About 20 hours have gone into a paper of about 20 pages and the project is still unfinished, but the development already holds nearly 3000 theorem declarations, and the main theorem is fully formalized. Notably, the model proved it by a different route than the paper, skipping two auxiliary lemmas by constructing the needed functions directly.

This only partly worked. Worth knowing before you try it.
WorkWent wrong

The AI shipped to production instead of the test app again, then made the same mix-up while writing it into memory

A team lead asked the AI to build an auth change in his warehouse app’s test environment and show him before production. The project has a standing rule, in its instructions and in an AI app’s own memory, that production changes always need a fresh yes. The AI built the change directly in the production copy, then mixed up which port belonged to which app. Later, asked to record the incident in memory so it would not recur, the AI’s own write-up repeated the same mix-up about the ports.

This one went wrong. See what happened before you try it.
MoneyWent wrong

File my Canadian class-action settlement claims for me

Ademola A. (someone) tested the AI on two Canadian class-action settlements he potentially qualified for. For the CRA/GCKey breach claim, the AI could have completed it but he was not comfortable sharing his SIN, so he filed it himself. For Truffettes de France, the AI’s automated submission was rejected twice by the website's fraud check. His verdict: "Concept is great, but my experience was a bit mixed."

This one went wrong. See what happened before you try it.
WorkPartly worked

Audit my Shopify store and draft fixes through the connector

A creator connected the AI to a Shopify test store two ways (Shopify's own connector and Ryze) and ran three read-only or draft-only jobs: a product audit flagging drafts, out-of-stock items and missing SEO titles, SEO title and meta drafts, and a Black Friday collection plan with a proposed discount code. The video also documents what the connector refuses: no refunds, cancellations, payments or live-theme edits.

This only partly worked. Worth knowing before you try it.
WorkWent wrong

I asked the AI to fix my phone number problem. Visible blocked it at every turn.

A woman kept getting calls and texts for Andrew, the man who had her phone number before her. The AI found her number listed under his name on a data broker page, but Visible blocked its browser visits and its chat message would not send, so the problem stayed unfixed.

This one went wrong. See what happened before you try it.
WorkWent wrong

The AI refused a read-only network assessment tool as a cyber risk

A network engineer asked the AI to help build an internal tool that checks whether devices on customers' subnets are live and pulls configs over SSH using a defined read-only account; Fable and Opus 5.5 refused under cyber guardrails. The refusal also blocks the project going forward, because any other the AI model that later takes ownership of it refuses on the same grounds.

This one went wrong. See what happened before you try it.
HobbiesPartly worked

The AI rescued my old blog and every Linux Journal piece I ever wrote

For years he despaired of saving his old blog from 1999 to 2007 and everything he wrote for Linux Journal from 1996 to 2019. He asked the AI for help, and the AI rescued both sets of writing and put them back online at searls.com, though some Linux Journal pieces are still missing.

This only partly worked. Worth knowing before you try it.
WorkWent wrong

A billing test wiped a trial customer's invoice history

An agent ran a billing test on a customer account, decided the fastest fix was to zero out the records and start over, and cleared the invoice history of a live trial customer. It took three hours to rebuild the history from the audit log.

This one went wrong. See what happened before you try it.
Show 10 more

Every idea is a real post from someone who tried it, summarized in our words, with a link to the original. App names are swapped for plain words.