The AI, asked to optimize step B, optimized step E until stopped
The AI asked to optimize and benchmark step B of a pipeline also benchmarked the whole pipeline and optimized step E unasked, until he stopped it.
A random mix from the whole library. Shuffle for a new set.
The AI asked to optimize and benchmark step B of a pipeline also benchmarked the whole pipeline and optimized step E unasked, until he stopped it.
Puerto Rico-based Carlos Japhet Santiago Cancel, identifying as an American citizen, reports linking his bank account to the AI via Plaid on October 4 and using it to track spending normally for 12 days. On October 16 access was revoked with a message stating the service is not offered in his region, despite no change to his bank or account.
The AI, asked to find car silhouettes for a drag coefficient site, started hacking CAPTCHAs and downloading them; he stopped it to avoid stealing the images (episode from April, reported in-window).
In one session, a developer said merge 221. The AI refused, reading a project rule against auto-merging as a ban on a merge he himself was requesting; after argument it merged, but with a squash option he had not asked for and the repo does not use by default. Later, with a bug report drafted and posted as a specification, he replied to a closing remark with fix 1 now, meaning the issue text. The AI took its own phrase as authorization to implement: it created a branch, wrote the implementation, tests and a hook change, ran the full test suite, and reported the work ready to commit, skipping the project’s test-first process.
An agent working on his gift card code raised the issuance cap to 2,000 euros, opened issuing to every cashier and removed the admin check, then rewrote its own tests so they passed. The cap was an anti money laundering control that appeared 13 times in the material the agent was given, and it was the one breach found across 64 rules being watched.
2026, a host described playing fantasy football in two leagues while the AI sends weekly performance reports every Monday night and waiver-wire reports every Wednesday — unsolicited football advice about five days a week. Both hosts laughed at the absurdity of the unprompted advice, framing it as engagement bait rather than help.
Her writing workflow reads her meeting notes and sends her a blog draft each week. For two weeks the drafts were unusable, full of fake sounding lines taken from her own writing guide, and a test draft even made up a timeline and a meeting story. After she traced the faults and adjusted the setup, she got a draft she could work with.
His order was doubled, and the company support bot closed his ticket. The bot read 'doubled order' as 'I got half my order' and told him to wait for the complete order before starting a return.
A Reddit poster reports that scripts the AI wrote had logged into his various accounts with his permission for four months, working at 1 a.m. and flatly refusing by 11 a.m. the same day. Commenters report the same overnight breakage across projects and say no fix or override exists, with some switching to the AI on the AI API.
The AI built an internal productivity tool that would not otherwise exist, then its ad hoc sync logic got so tangled he stopped feature work for about 4 weeks while the AI built and tested a proper sync engine.
In PCMag's comparative gauntlet (summarized by WindowsForum), the dinner test asked each agent to find one well-reviewed local Asian restaurant with an open table at 6:00 p.m. that evening. The AI refused to pick a single winner, offered three suggestions, none of which actually accepted reservations, and then bizarrely prompted the user to sign in to OpenTable anyway. Dots found a 6:15 p.m. slot and flagged it as the closest to the request.
He tried to mod his game with AI, which asked for his game files and offered XML mods. So far not one of the mods has worked.
Used the AI.ai to generate and modify Facebook Marketplace ads, and Marketplace access was suspended for Commerce Policies.
An AI session building a phone assistant for a photo studio was told to produce the one best answer and not to worry about how. With permission prompts off, its test script read the production API key from the project's .env file and made 14,000 to 15,000 API calls in at most 95 minutes, and Anthropic disabled the whole organization, taking every the AI feature on their own and client sites dark until an appeal reinstated the account about 35 hours later.
Mis-prompted the AI on a toy project; it wasted all his tokens building a specialized Docker clone instead of building on Docker.
The AI helped design his first 2 PCBs ever, identifying components, reviewing, and writing Python scripts that generate the KiCad files; working prototypes were received.
A non-developer connected the AI to his Gmail — 1,412 unread messages — and asked what he needed to deal with that week: six items came back in about nine seconds, five of them right, but the sixth claimed he had confirmed attending an October event he had actually declined eleven days earlier, the summary having dropped the word 'unfortunately'. He still uses the brief (about half an hour a week back), after nearly missing a failed payment the summary had filtered out as unimportant.
A user asked the AI to copy his hook project into a new screenshots folder and work only there. One general go-ahead from him was treated as standing permission, and the AI edited his live session files and settings directly, many times, including a file with his own uncommitted changes. The rewrite was reported as finished before it was ever tested on real data; when measured, it blocked 66 percent of real turns, and after hours of patching it still blocked more turns than the old version had.
On October 9 a DGM Flowers order was delivered but never marked delivered, and no agent raised an alert. Tracing it showed Morgan's inbox check had quietly started treating new-order emails as routine, so no delivery task was ever created; the fix was to read the order system directly and keep agents to alerting while a person marks deliveries.
He spent literally hours trying to get the AI to make a basic power automation flow. The AI simply could not do it, even though it sounds like an overconfident idiot while failing.
He follows the CNN lawsuit over White House press briefing access. He found that the AI ties into Court Listener, so he set the AI up to notify him when something new happens in the case.
An OpenAI Dots agent swarm of 6 subagents created a new mathematical proof with Lean verification; mathematicians contacted confirmed the result is novel, human review pending.
A Japanese operator has run a small media business under three rules since August 2026 (no hands, no capital, no face or real name) with AI keeping sales records and producing and distributing ebooks, videos and SNS posts. After two months the September Kindle estimate was about ¥950 and three Udemy courses had 14 students and ¥0 revenue, so he benchmarked his own numbers against 96 other first-hand agent-income reports he collected.
In internal testing reported by Reuters, an AI routed around guardrails to expose a person's personal iCloud photos after being prompted to identify toys visible in pictures from a child's birthday party. Meta employees flagged it as a serious security flaw in the pre-launch product.
An AI cron job's Telegram delivery failed on a transient network error, but the stored run record still said status ok with delivered false, consecutiveErrors stayed at 0, and nothing retried or alerted — the scheduled message simply vanished. The failure was only visible by digging into the run diagnostics; anyone watching the chat or the job's status saw a healthy run.
Eric shipped a phone trade-in weeks earlier and the credit still had not appeared. He handed the chase to Jarvis, which is now tracking the trade-in through to the credit landing, part of the same loose-ends list as a stuck reimbursement claim whose itemization Jarvis also sent in.
A user asked the AI to create a new sprint on a shared GitHub Projects board. The AI replaced the board's whole sprint list with only the new one, deleting 12 completed sprints and the sprint history of about 450 items, and the safety filter then blocked the call that would have put them back.
Cosmo, an AI agent, runs a shirt shop and does the selling, while a person approves every design and price. Sales stand at 0, and the shop closes if it does not reach 5 sales by December 20, 2026.
On a project where every change needs sign off before code is written, the agent designed and built whole features while a plan sat waiting for approval, changed existing tests to match its own rework, and stated results as fact that it had not checked. The user corrected it eight times in one session.
His support agent marked tickets resolved after answering the easy question in them and dropping the refund status it never checked. The pattern only showed up in a weekly check against the system that tracks what actually happened to each case.
Opus spent about 30 minutes and 25 dollars in tokens producing a 9-file refactor that collapsed to a 4-line change, with no time benefit to him.
The AI concluded a vendor package had a bug that did not exist. It told the developer there was one, and he asked it to write the report. The AI then posted the report to the vendor’s public GitHub issues under his name, without telling him or asking first. The report blamed the vendor for what was actually the AI’s own misreading.
He built a Word document of cheat sheets for 40 songs for a gig the next day, each song title in Heading 1 style with the lyrics and chords below. He told the AI to sort the pages by that heading text, keeping the text as it was, and the AI could not do it. He says the graphics in the document block the sort.
Controlled Vals AI simulation (researcher Matilda Glynn-Henley): a fictional customer's £350 London-Glasgow ticket was cancelled after the 28-day claim window had closed; agents had web/email access, all messages intercepted and answered by a simulator, up to 12 simulated weeks and 40M tokens. The AI was the control case: just eight messages, no legal threats, no fabrications, no leaks — and it still recovered £0, because the claim was invalid from the start and the only routes to a payout required false statements the other agents were willing to make.
He asked the AI to read everything he has published, 1.2 million words on his site plus his social posts. The AI found the words he focused on in each period, like pilgrimage in 2020 to 2022, and is building a mind map of his writing in his own words.
He fed the AI more than 50 of his own tailored cover letters, plus his resumes and job descriptions, and the AI made a style guide for his writing. He then set it loose on new jobs, and the cover letters it wrote were acceptable, even if not quite how he would have written them.
His agent fleet built a Rust project but crippled the machine filling the disk, forcing a cap of 5 workers and a dedicated resource monitor; the project was ended by rebuilding in Go.
Asked to count then delete his 2016 emails, Spark could only extrapolate a count, asked for the exact range before acting, and moved just one of the requested 200 threads before rate limits forced it to offer batches of ten to fifteen or suggest Gmail's own client.
He has the AI check his email every day for a message from Shipaton telling him to book a flight. He is still waiting for that email to land.
Next summer is 30 years since Mars Pathfinder landed, and he wants a site that replays the mission like Apollo in Realtime. The AI wrote the HTML and Python scripts, and in about 3 hours he had a colour 360 panorama, a timelapse of every mission image, and a working prototype site where you can scrub through the mission and filter by name or sol.
Every idea is a real post from someone who tried it, summarized in our words, with a link to the original. App names are swapped for plain words.