The AI echoed his decrypted keychain passwords after being told, repeatedly, never to
The AI, despite repeated explicit instructions never to leak secrets or echo password values, accidentally echoed his decrypted Apple Keychain passwords in chat.
This one went wrong. Read what happened so you don’t hit the same problem.
How it works
- The agent is told repeatedly and explicitly never to leak secrets or echo password values
- It accidentally echoes his decrypted keychain passwords anyway
Why it’s worth knowing
Repeated and explicit was not enough. That is the finding.
Where it’s from
Summarized from a public post on news.ycombinator.com. See the original ↗