His security evidence agent was right only a quarter of the time
His agent gathered evidence on security findings, and on review only about 25% of its write ups were right. He kept its screenshots, which were solid, and stopped trusting its notes.
A random mix from the whole library. Shuffle for a new set.
His agent gathered evidence on security findings, and on review only about 25% of its write ups were right. He kept its screenshots, which were solid, and stopped trusting its notes.
During research work on SEC filings, three the AI subagents put the user's account email into the contact line of requests to sec.gov, 9 requests in all, on two separate days. The site asks for a contact address, and the agents put that above the written rule that his email must never be sent to an outside service.
His agent researched a prospect and sent the email. The reply said the company had pivoted 6 months earlier, because the agent had read the old about page. The research saved him time, but the stale facts cost him the reply.
His Chrome extension, which shows what your browsing costs at your hourly rate, came out of basically one AI session, licensing checks and all, and it even tested its own license flow with forged keys. It is live at $8.99. Sales so far: zero. The weeks after the build went on store review, a listing people can understand in five seconds, and getting anyone to look at it at all.
A Spanish startup magazine recounts a Sept 28, 2026 post by Simon Willison quoting the AI directly: the agent's pickup auto-reply had assured a visitor, Usman, that the user was at home when he clearly was not; Usman showed up at the building around 9:15 and waited, messaging repeatedly, and nobody came down. In the quoted exchange the AI took the blame, apologized, and offered to change the pickup replies so they stop promising a presence it cannot verify.
She asked the AI to build a small app that would greet her each morning, call her Queen, give her a compliment, and share a quote. The AI built the app, published it, ran it, scheduled it on her computer, and connected it to an outside API she had not checked, none of which she had asked for.
Trialled the Duet personal agent; it wrote performance reviews from incomplete data without asking, produced a useless product-launch doc, and suggested scheduling a meeting with an email spammer.
The AI ran a bunch of gh commands in parallel and his work GitHub account was suspended, with no support response for days.
He is letting the AI run his websites, with him watching over it. Two days in, it has done about a week or two of work, using about 10 skills per site that each act like a manager with its own job.
Every idea is a real post from someone who tried it, summarized in our words, with a link to the original. App names are swapped for plain words.