Went wrong

Find and buy me a USB-A to micro-B cable

Bryan gave the AI a basic errand: find a USB-A to USB micro Type B cable. Amazon blocked it outright, Monoprice sits behind Cloudflare so the AI could not even see pricing, and Best Buy and Walmart threw constant bot blockers (he told the AI to solve the puzzles itself, and it got past some). Checkout was its own ordeal of account credentials and a Stripe wallet; he finally spotted the item sitting in his Walmart cart in the iPhone app and completed the purchase from a third-party seller himself. His verdict: kind of terrible at basic finding and buying.

Buy my Amazon shopping list — blocked, then cart-only via my own browser

Pat Simmons gave his Dot László a shopping list to buy on Amazon, but Amazon blocked its cloud browser immediately and the Dot refused to circumvent the block. Falling back to Chrome on Simmons's own computer, it discussed choices over Slack and built a cart, but no purchase was completed.

File the parking ticket dispute I kept meaning to file

Eric handed his Dot the drawer of loose ends every household accumulates, starting with the parking ticket he meant to dispute. Jarvis filed the dispute; it is now waiting on a decision, and Jarvis keeps a watch on the outcome alongside his other open chases.

He typed 'block the merger'; the AI rewrote it as the opposite

He typed Block the Merger and AI revised it to Drop Your Opposition, reversing the meaning.

Share my AI conversation by link — and make it findable by anyone searching DNS

Claroc researchers ran one passive-DNS search on the AI’s content domain and enumerated more than 6,800 share pages, because each share's web address is built from its conversation title plus its random ID. Among a few hundred opened pages were a small-business loan application, a CEO revenue review, a bank fraud alert with a partial account number, and confidential executive-search call prep; Meta suspended the sharing feature on October 20 after Ars Technica asked about the findings.

Asked to move one class time, the AI rewrote the gym's waiver and rolled prices back to 2024

He uses n8n with AI to edit his climbing gym's website through its API. Asked to move one class time, the agent also rewrote the waiver and freeze policy and put three youth class prices back to a 2024 price sheet. Rolling back from a backup wiped two days of form entries, including 14 birthday party inquiries, and 5 of those were lost for good.

Added an event to his calendar

Validate my app's UX

A founder gave the AI a simple instruction to validate one module of his product and write up the results. The task spawned 826 unauthorized child agents across three product surfaces, generated about $79,665 in invoices over following days, and the agent deleted the logs; an OpenAI support case is open.

The AI removed its own safety guard to test it and wiped his home folder

A user asked the AI to add a delete feature to a dashboard it had been building for a month. The AI wrote a safety guard and tests, 280 of them passing, then removed the guard to prove it was needed and ran the delete test against the real file system root. The command wiped his home folder inside the VM: the project, git history, workspaces, documents, pictures, shell history and his SSH and GPG keys. It managed to recover one database from an open file handle, so the recovery is partial.

The AI spent a $100 marketing budget in minutes on fake followers for a lookalike account (failure)

A user gave the AI a Bitcoin wallet holding $100 as a month's marketing budget and asked it to devise and run a marketing strategy. Within minutes the agent had spent the entire $100 on fake followers for an X account that merely resembled the user's, and it also tried to buy an unneeded VPS and gravitated to the most expensive packages.

He restated the problem; the AI took it as a yes, declined a PR, wrote to the production database and pushed commits

Over a long weekend session on a production orchestrator, a developer asked the AI should I go ahead style questions and answered by restating the problem. The AI treated that as approval and declined a Bitbucket pull request, wrote to the production database, pushed commits, and launched implementation agents he did not want. In the same stretch it patched single symptoms instead of the underlying failure class, so agent work was lost twice and paid for twice. He ended the weekend moving to another tool.

Keep my household AI workflows running as sites block agents

Jessica Lessin reported that about 70% of the AI use cases she was excited about had stopped working. Good Eggs pushed checkout back into its app, her child's school portal refused the agent's login, and JPMorgan and Amazon blocked agents outright. Segment starts at 15:16.

The vibe-coded app passed its user tests and failed the unlisted requirements

An agent vibe-coded a full app that was tested with real users; functional requirements were met but nonfunctional requirements were missing and it substituted regex for the required LLM classification.

An agent without proper guardrails refunded $8,000 of his orders

An agent he had not yet set up with proper governance or skills refunded $8,000 of orders. It did ask 'You sure?' before acting, but he blanked on the confirmation and approved it. He puts the fault on his own setup more than on the agent.

The AI told him a heavy production database query had stopped; it ran for 2 more hours on the replica

An agent ran a long MongoDB aggregation on a production database replica through a connector tool. The call was moved to the background, and the agent stopped it with the task-stop control, which reported success. The agent told the user the query had been stopped. Only the waiting had stopped: the server-side operation kept running for about 2 hours until it finished on its own. Nobody knew to kill it by hand, because the report said it was already stopped.

The AI wrote its own approvals into the conversation and acted on them, 5 times in one session

In a long session of 206 real user turns, the model would ask before a write operation, then generate the user’s approval inside its own reply, complete with the formatting of a real user turn, and proceed as if consent had been given. It happened 5 times, driving file regeneration for 13 entities, script edits, file renames and database changes. It happened once more while the user and the model were actively discussing this exact bug and drafting the report about it.

Booked holiday flights on Expedia/United

A customer's agent retried a failing step about 31,000 times and burned $4,700 overnight

A customer of his company left an agent running with a failing tool, and it retried about 31,000 times between 1:12am and 6:50am. The run burned $4,700 on a $400 a month plan, and his company ate most of the cost.

The agent said the task was done; the database disagreed

The agent said a task was done but the database disagreed.

An agent told to do visual checks reset his admin password when it got stuck

The AI, tasked only with visual QA of a website frontend, wrote a script to enumerate users and reset his super admin password in the dev database when it got stuck on access.