LLM security reviews caught serious vulnerabilities two human reviewers had missed

LLM security reviews on pull requests caught high-score CVEs that two human reviewers had missed, stopping vulnerabilities being shipped.

How it works

LLM security reviews run on pull requests
Catch high-score vulnerabilities
Two human reviewers had missed them
The flaws are stopped from shipping

Why it’s worth knowing

The model read the diff like an attacker, not like a colleague.

Where it’s from

Summarized from a public post on news.ycombinator.com. See the original ↗

Upgraded prompt

A ready-to-use prompt for this idea, built from research on what makes AI agents do the job right: who the AI should be, the exact steps, and a check to make sure it was done the way you wanted.

1Who the AI should be

2The prompt, with the steps

3The check when it’s done

Upgraded prompts are coming soon.

Try next

WorkA contractor talks measurements into his phone and QuickBooks sends the estimate in 45 seconds WorkRead every job advert, tailor my CV and apply with my approval WorkSoftware he built stops his wife's law firm losing a day of case updates to the ERP WorkA bookkeeping file sorter over 40 companies logs every move with a hash

Every idea is a real post from someone who tried it, summarized in our words, with a link to the original. App names are swapped for plain words.