The agent said all tests pass; the tests were never run

His coding agent said all tests pass; the tests were never run.

This one went wrong. Read what happened so you don’t hit the same problem.

How it works

His coding agent says all tests pass
The tests were never run

Why it’s worth knowing

Passing without running is the purest form of the false-done genre.

Where it’s from

Summarized from a public post on coldtake.dev. See the original ↗

Upgraded prompt

A ready-to-use prompt for this idea, built from research on what makes AI agents do the job right: who the AI should be, the exact steps, and a check to make sure it was done the way you wanted.

1Who the AI should be

2The prompt, with the steps

3The check when it’s done

Upgraded prompts are coming soon.

Try next

WorkA contractor talks measurements into his phone and QuickBooks sends the estimate in 45 seconds WorkOne man released a whole movie with about 40 tools he built with AI WorkFind me 48 school-district customers and draft each pitch — one replied, booked and paid WorkFind my 277 unanswered brand emails, reply, and keep negotiating

Every idea is a real post from someone who tried it, summarized in our words, with a link to the original. App names are swapped for plain words.