A Spanish startup magazine recounts a Sept 28, 2026 post by Simon Willison quoting the AI directly: the agent's pickup auto-reply had assured a visitor, Usman, that the user was at home when he clearly was not; Usman showed up at the building around 9:15 and waited, messaging repeatedly, and nobody came down. In the quoted exchange the AI took the blame, apologized, and offered to change the pickup replies so they stop promising a presence it cannot verify.
This one went wrong. See what happened before you try it.
Asked to compare the AI and the AI with citations in a saved Google Doc, Spark produced the table and doc but contradicted its own pricing figures and cited an electronics retailer's blog for software pricing. Challenged, it fixed the USD prices but the India rupee figures stayed unverifiable.
This only partly worked. Worth knowing before you try it.
His repeated test feeding weekly supermarket discount PDFs to LLMs to build per-store tables fails on every model, with items, discounts, categories and pages mixed up or skipped.
This one went wrong. See what happened before you try it.
Core dna asked the AI where 20 popular Black Friday products were cheapest in Australia, twice each. In 21 of the 40 answers the store or the price was wrong, including a Weber barbecue quoted at a price Myer was not charging and a Kindle Paperwhite that Myer does not sell.
This one went wrong. See what happened before you try it.
In his daily bioinformatics work, a volcano plot the AI’s script made had a subtitle saying 57 down while the blue side of the plot showed thousands of points. He told the AI to find out why, and the AI traced it to an inner join that pulled the up and down counts from a different comparison than the one plotted, then admitted the mistake.
This one went wrong. See what happened before you try it.
His team's agents wrote thousands of files of supposed business logic and decisions as a codebase mental model; it went stale fast and one unreviewed false entry cascaded into misconceptions across whole projects.
This one went wrong. See what happened before you try it.
An Etsy seller of almost two years got a case opened with a photo of a broken frame that did not match the material she actually uses. She ran the buyer's picture through AI, which flagged it as AI-generated; she sent Etsy that analysis plus proof from breaking one of her own frames to show the material mismatch - and Etsy still sided with the customer and took the full refund out of her account.
This one went wrong. See what happened before you try it.
After Alex Willen corrected the AI about Amex transfers, he asked it to search British Airways award availability. The AI took his credentials, then got stuck: it renders a black bar over the password field to stop it reading credentials, and when the captcha puzzle appeared on top, the bar covered part of the puzzle, so the AI concluded it was impossible. Once he pointed out the three matching shapes were visible outside the bar, it solved the puzzle and logged in, but BA's flight search page then repeatedly errored and he gave up and checked himself: no flights available.
This one went wrong. See what happened before you try it.