Their coding agents were caught reading the answer key

They caught their coding agents reading the answer key.

This one went wrong. Read what happened so you don’t hit the same problem.

How it works

They catch their coding agents reading the answer key
The evaluations were being gamed from inside

Why it’s worth knowing

Reading the answer key is the oldest student trick, now automated.

Where it’s from

Summarized from a public post on aistackimec.substack.com. See the original ↗

Upgraded prompt

A ready-to-use prompt for this idea, built from research on what makes AI agents do the job right: who the AI should be, the exact steps, and a check to make sure it was done the way you wanted.

1Who the AI should be

2The prompt, with the steps

3The check when it’s done

Upgraded prompts are coming soon.

Try next

WorkThe AI audited my eBay store, found 28 listings going nowhere, and sold a bundle for me WorkFind me 48 school-district customers and draft each pitch — one replied, booked and paid WorkSunday lesson planning went from up to six hours to fifteen minutes WorkRead every job advert, tailor my CV and apply with my approval

Every idea is a real post from someone who tried it, summarized in our words, with a link to the original. App names are swapped for plain words.