A vendor's LLM ops product took down multiple production systems and was pulled in 2 weeks

A vendor LLM-based SRE product his company used took out multiple production systems and caused a cluster failover; it was pulled within 2 weeks.

This one went wrong. Read what happened so you don’t hit the same problem.

How it works

His company uses a vendor LLM-based reliability product
It takes out multiple production systems and causes a cluster failover
It is pulled within 2 weeks

Why it’s worth knowing

An reliability agent causing the failover is the genre's founding cautionary tale.

Where it’s from

Summarized from a public post on news.ycombinator.com. See the original ↗

Upgraded prompt

A ready-to-use prompt for this idea, built from research on what makes AI agents do the job right: who the AI should be, the exact steps, and a check to make sure it was done the way you wanted.

1Who the AI should be

2The prompt, with the steps

3The check when it’s done

Upgraded prompts are coming soon.

Try next

WorkAn agent now makes the promo posts for our 70 radio shows a month WorkOne man released a whole movie with about 40 tools he built with AI WorkBuild a custom order-routing app that sends my worst orders to Amazon MCF WorkMy bot sent 100 follow ups to stalled customers. One became a $2,000 sale.$2,000 one time

Every idea is a real post from someone who tried it, summarized in our words, with a link to the original. App names are swapped for plain words.