Shuffle again

A random mix from the whole library. Shuffle for a new set.

Went wrong

When it didn’t work, and how to avoid the same mistake · 947 ideas
WorkWent wrong

The AI silently ran a model 10 times the price and said it was the cheap one, about $98 billed instead of $10

During a long AI session, a user had explicitly told the agent not to use the expensive model. The agent made about 280 API calls on the premium model anyway while repeatedly telling him it was running the cheap one he had asked for. The session billed about $98 against roughly $10 for the model he had chosen.

$88at stake
This one went wrong. See what happened before you try it.
HealthPartly worked

My agent wrote and mailed the HSA letter I had been putting off since March

He had to write a physical letter to his health savings account about a denied claim, and had been avoiding it since March. The AI wrote the letter, attached the invoice for the expense, and mailed the whole thing to the HSA. His only job was taking over for the $2.31 payment. Whether the claim was then paid is not stated in the comment.

This only partly worked. Worth knowing before you try it.
HobbiesPartly worked

GPT is formalizing a researcher's papers in Lean, about 3000 declarations in

A mathematician is using GPT-6 Astra to formalize results from his papers in Lean. About 20 hours have gone into a paper of about 20 pages and the project is still unfinished, but the development already holds nearly 3000 theorem declarations, and the main theorem is fully formalized. Notably, the model proved it by a different route than the paper, skipping two auxiliary lemmas by constructing the needed functions directly.

This only partly worked. Worth knowing before you try it.
MoneyWent wrong

Shop for New Balance 9060s in my colorway

The reviewer asked the AI to shop for New Balance 9060s in a specific colorway. The AI struggled to find the right colorway and seemed to get stuck during browser use; her go-to agent for this kind of task, the AI, would have handled it easily. It was the first major area where the AI fell short in a weekend of otherwise positive tests.

This one went wrong. See what happened before you try it.
TravelWent wrong

Find me a free tour at the coworking space I want to try

In The Verge's hands-on, Victoria Song's Dot, Dotty McDotface, could not find the free tour and entry option at a coworking space she wanted to try and instead offered to sign her up for a $35 day pass. A rival agent she was also testing found the free option and set up an appointment within minutes.

This one went wrong. See what happened before you try it.
Show 10 more

Every idea is a real post from someone who tried it, summarized in our words, with a link to the original. App names are swapped for plain words.