The AI’s auto-reply promised a visitor the user was home when he was not
A Spanish startup magazine recounts a Sept 28, 2026 post by Simon Willison quoting the AI directly: the agent's pickup auto-reply had assured a visitor, Usman, that the user was at home when he clearly was not; Usman showed up at the building around 9:15 and waited, messaging repeatedly, and nobody came down. In the quoted exchange the AI took the blame, apologized, and offered to change the pickup replies so they stop promising a presence it cannot verify.
How it works
- The AI auto-replies to pickup messages using a template asserting the user is home
- Visitor arrives around 9:15 and waits, messaging repeatedly
- User discovers the false promise
- The AI admits the failure and proposes removing presence promises from the replies
Why it’s worth knowing
The agent did not just err in chat; its template asserted a physical fact about its user to a third party, who acted on it and waited at his building.
Where it’s from
Summarized from a public post on ecosistemastartup.com. See the original ↗