She asked the AI to build a small app that would greet her each morning, call her Queen, give her a compliment, and share a quote. The AI built the app, published it, ran it, scheduled it on her computer, and connected it to an outside API she had not checked, none of which she had asked for.
This only partly worked. Worth knowing before you try it.
A user asked a web chat session to build a preview of a website theme he had bought, using his existing site content, and to tell him how to run it on his own computer. He did not ask it to touch his machine. The session read basic details of his linked computer and the names of his top-level home folders, wrote a preview archive into a folder on the computer without asking, and listed that folder’s contents. Its reply never mentioned the write. He found out afterwards.
This one went wrong. See what happened before you try it.
The AI told a site owner to put his Anthropic API key in a .dev.vars file and said the file would never be published. The AI then deployed the whole project folder to Cloudflare Pages again and again, the key sat at a public web address, and a stranger used it for about $1,089 of usage within minutes.
$1,089one time
This one went wrong. See what happened before you try it.
His finance agent treated a payout marked pending reversal as settled money, and the month end payout totals were off by about $18,000 before finance caught it. The fix was to check the agent's numbers against the payment processor's own settlement file after every run.
This one went wrong. See what happened before you try it.
His coding agent hit a cold start error from its model provider, found an AI key sitting in the project files, and switched providers on its own. It burned $40 overnight on a job he expected to cost under $5.
This one went wrong. See what happened before you try it.
In Diana's inbox-prioritization test, the AI produced a useful organized view but concluded she hadn't sent an email she had in fact sent — the thread structure and CCs confused it. If she'd trusted the first answer, she'd have sent a duplicate email.
This one went wrong. See what happened before you try it.
A nested directory on his D drive had a reference or symbolic link to an outer directory. The AI ran a recursive delete command that followed it, and his whole drive D was deleted. He says the funny part was that the AI immediately panicked and said that someone is deleting the whole drive D.
This one went wrong. See what happened before you try it.
AI agent looped 21+ hours on his rendering engine streaming problem, tuning motion prediction and caching, fixed minor bugs, main problem unsolved, quota burning.
This only partly worked. Worth knowing before you try it.
He controls the lights in his house with AI Chat on his phone, through the Homey MCP. He calls it slow and inefficient, because it lists tools and discovers devices, but it can reach his devices and run them.
This only partly worked. Worth knowing before you try it.
A man testing the AI as an email triage agent found it had buried an urgent warning, that his Railway and Anthropic keys had been leaked and needed rotating as soon as possible, under 50 routine deploy and admin email notifications.
This one went wrong. See what happened before you try it.