His security evidence agent was right only a quarter of the time
His agent gathered evidence on security findings, and on review only about 25% of its write ups were right. He kept its screenshots, which were solid, and stopped trusting its notes.
This one went wrong. Read what happened so you don’t hit the same problem.
How it works
- The agent gathers evidence on each finding
- It takes screenshots
- It writes up what the evidence shows
- His review finds only about a quarter of the write ups right
Why it’s worth knowing
The split is the lesson: its screenshots were evidence, its sentences were guesses, and only one of the two deserved trust.
Where it’s from
Summarized from a public post on reddit.com. See the original ↗