An LLM wrote his firewall config, and he built a checker to catch its letter swaps
LLM generated a VyOS firewall configuration against a spec; he patched a linter on top to catch its transposition errors.
This only partly worked. Read what happened before you try it.
How it works
- The LLM generates the firewall configuration against a spec
- It makes transposition errors
- He patches a linter on top to catch them
Why it’s worth knowing
The fix for an agent that swaps letters is a machine that reads letters.
Where it’s from
Summarized from a public post on news.ycombinator.com. See the original ↗