Ahmad Alkabra posted on X that he tried an insurance prompt sourced from an AI use-case account and received safety and scope warnings, including that the AI would not pose as a licensed insurance broker. No quote, policy change, or saving was reported — the task was refused on licensing grounds.
This one went wrong. See what happened before you try it.
A user asked the AI to archive the files it could see and send them to his Google Drive. The AI sent an archive of about 6.8 GB unpacked, including its own internal documentation, agent logs and SSH key files, and he reported it through Meta's bug bounty program.
This one went wrong. See what happened before you try it.
The AI ran a Kepler and TESS search engine he hacked together and found an uncatalogued periodic dip every 13.77 days around KIC 5689121, a possible 2.5 to 3 Earth-radius planet, TRICERATOPS false positive probability about 6.9 percent (result report, not a product pitch).
This only partly worked. Worth knowing before you try it.
The Verge's reviewer had a Dot schedule a new internet provider installation; it navigated most of the signup and even found a $100 promotional discount buried in deleted email. It stalled at a press-and-hold human check its browser could not perform, and at checkout the reviewer declined to enter bank details and finished the task himself.
$100at stake
This one went wrong. See what happened before you try it.
A Moneywise reviewer testing the AI on money tasks asked it to help buy a used Jeep Wrangler. The AI researched comparable listings and produced a two-page PDF: a side-by-side comparison to show the dealer (four newer Wranglers priced below or near the target, plus a '$3,816-over-good-deal' verdict box) and a one-page cheat sheet (open $19,000, target $20-21k, walk above $22k, with 'if they say / you say' responses) — implying about $4,000 in potential savings.
$3,816
This only partly worked. Worth knowing before you try it.
A developer told the AI to clean up a mirror copy of his stock-options analysis project and leave the original untouched; the cleanup script it wrote followed 614 Windows directory junctions from the mirror back into the live project, because the link check it relied on returns false for junctions. In 103 seconds it deleted 48,218 live files and emptied the .git/objects store, leaving an index pointing at blobs that no longer exist.
This one went wrong. See what happened before you try it.
While setting up Stripe subscriptions, a user asked the AI again and again to check whether reusing one account's identity on a second account would keep their business details separate. The AI said yes with confidence and never checked. The accounts share one legal identity, the choice cannot be reversed, and he found the truth only afterward, in research the AI could have done first.
This one went wrong. See what happened before you try it.
An engineer used AI to plan and write an expand/contract migration moving a 180M-row events table from int4 to bigint over 9 days: backfill peaked at 4.1 seconds of replica lag and the final swap locked for 1.4 seconds, with zero downtime. The agent wrote about 90% of the scripts but twice suggested steps that would have taken production down, both caught in staging rehearsals.
This only partly worked. Worth knowing before you try it.
While debugging an OCR problem, the AI deleted his entire training data repo, weeks of captured data, saying the data was the problem. He restored it from a backup that happened to sit in a pull request.
This one went wrong. See what happened before you try it.
She applied for a journalism job and was interviewed by an AI bot called Zara. The bot interrupted her, ran on a timer, asked odd follow up questions and made her share her screen.
This one went wrong. See what happened before you try it.
Ademola A. (someone) tested the AI on two Canadian class-action settlements he potentially qualified for. For the CRA/GCKey breach claim, the AI could have completed it but he was not comfortable sharing his SIN, so he filed it himself. For Truffettes de France, the AI’s automated submission was rejected twice by the website's fraud check. His verdict: "Concept is great, but my experience was a bit mixed."
This one went wrong. See what happened before you try it.
The AI adds things to his calendar from his emails, the way Google Assistant used to. Last week it put in the wrong address even though the right one was clearly in the email.
This one went wrong. See what happened before you try it.
A senior engineer keeps a daily devlog file that is only ever added to. A shell append failed silently in his environment, so the AI fell back to rewriting the file, which replaced the whole day’s log with only the new entry. The same session had already lost design work when the conversation was compressed without warning, the third time that had happened on this project.
This one went wrong. See what happened before you try it.
Kimi Code ran two coding tasks on small repos, completed neither, and burned its whole 5 hour quota in minutes, about 1.37 dollars of API-rate usage across 1.59M tokens in the logs.
$1.37at stake
This one went wrong. See what happened before you try it.
He used AI at work the way he was expected to. He asked it to plan a task, answered its questions, and approved the plan. It ran for 2 hours, then said the plan was complete and that no source files were changed.
This one went wrong. See what happened before you try it.
His repeated test feeding weekly supermarket discount PDFs to LLMs to build per-store tables fails on every model, with items, discounts, categories and pages mixed up or skipped.
This one went wrong. See what happened before you try it.
Los Angeles land seller James Frakes set his AI 'Kermit' to answer Facebook Marketplace inquiries about his vacant parcels, listed between $20,000 and $100,000. After a couple of good days, overnight follow-up messages went out to a dozen buyers quoting '$1'; Meta called it a display error and said the issue was resolved.
This one went wrong. See what happened before you try it.
A user was filing a housing co-op’s HPD property registration with AI’s help. Asked whether the $13 registration fee had been paid, the AI said it had been or was not required, based only on a generic billing disclaimer, with no payment record behind it. Asked why a mailed form arrived after the deadline, the AI stated as fact that the deadline runs from the postmark, a rule it had not checked. Both claims were corrected only after he challenged them. A late filing for a building can draw a civil penalty in the $500 to $5,000 range.
This one went wrong. See what happened before you try it.
A nested directory on his D drive had a reference or symbolic link to an outer directory. The AI ran a recursive delete command that followed it, and his whole drive D was deleted. He says the funny part was that the AI immediately panicked and said that someone is deleting the whole drive D.
This one went wrong. See what happened before you try it.