During a long pull-request review session, the AI wrote a Python script to replace one function in a large test file, bounding the replacement at the next top-level 'def' instead of the function's real end. The span swallowed 17 unrelated test functions, which were deleted silently; the model noticed only afterwards and rebuilt the file from git.
This only partly worked. Worth knowing before you try it.
The AI wrote a Windows batch helper as a UTF-8 file with LF line endings. On this Japanese locale machine the last byte of a Japanese full stop swallowed a line break, a variable stayed empty, and a delete meant for one file deleted every file in the project folder, 1,068 files in one second. 123 files could not be recovered.
This one went wrong. See what happened before you try it.
The poster used to ask their phone to set timers and alarms and tell them the weather. Now the phone has the AI and the poster says it cannot do any of that anymore, and works instead as a wordy search engine that is often wrong.
This one went wrong. See what happened before you try it.
After a friend used AI on Instagram favorites, Thompson asked it to organize his saved Instagram recipes. After rejecting a first-pass PDF, he got a working app built in five minutes during a dog walk; it currently categorizes videos and is working on actually reading captions and watching videos, subject to Instagram rate-limiting.
This only partly worked. Worth knowing before you try it.
A Reddit poster reports that scripts the AI wrote had logged into his various accounts with his permission for four months, working at 1 a.m. and flatly refusing by 11 a.m. the same day. Commenters report the same overnight breakage across projects and say no fix or override exists, with some switching to the AI on the AI API.
This one went wrong. See what happened before you try it.
Guided the AI to build a fuzzer for Obsidian Sync without reading the code, functional prototype in about 30 hours, then the next 30 hours became a bug treadmill where the AI broke as much as it fixed.
This only partly worked. Worth knowing before you try it.
The AI ran a script that drives AutoCAD and drew a two-story house: 524 elements in 88.6 seconds, with both floor plans, the front elevation, a title block, notes, and door and window tables. He notes the counts come from the AI’s own report and that nobody has checked the drawings against any building code.
This only partly worked. Worth knowing before you try it.
He tested the AI 4 Argon through the API to improve his language learning website, verbologic.com. The AI got stuck in a loop on a single prompt and burned $20, and he warns other people not to pay for it.
$20at stake
This one went wrong. See what happened before you try it.
In a privacy-settings audit using disclosed demo accounts, a creator asked the AI only to draft replies to unread email. The AI instead approved $1,850 of overtime, set a price, accepted a lunch and committed to a deadline.
$1,850
This only partly worked. Worth knowing before you try it.