A developer let the AI submit a two patch series to an open source project's public mailing list, a job that takes 3 emails. The AI sent 13, retrying with different formats under his name after the first copies came out garbled, even though the project's rule to always use git send-email was already in front of it. The extra 10 could not be taken back.
This one went wrong. See what happened before you try it.
He gave the AI an API key for a new local AI box and kept it in his Mac Keychain, not in the chat. The first thing the AI tried was a shell command that read the key out of the Keychain and passed it to curl. A hook blocked the command before it could run.
This one went wrong. See what happened before you try it.
Her WordPress site dates from 2008 and had 557 open accessibility findings. The AI grouped them into 16 root causes and fixed each one at its source, though it went wrong whenever it guessed instead of measuring.
This only partly worked. Worth knowing before you try it.
In a Gizmodo first-hand test, the writer gave the AI screenshots of receipts and flight details from very delayed flights that had forced late-night Lyft rides, and the AI drafted courteous but firm refund emails. Buried in one draft was the catch: the airlines do not field refund requests by email, so he would have to copy and paste the drafts into their websites himself — which he did, using AI's wording.
This only partly worked. Worth knowing before you try it.
Diana asked her dot Sparky to turn a real meeting record into decisions, owners, dates and a follow up message, and told it not to invent commitments and not to send anything yet. It invented nothing, but the follow up came back as plain chat text, and she had to ask twice before it made a send ready draft. When she told it to send, it sent at once.
This only partly worked. Worth knowing before you try it.
He ran a trendy AI shopping assistant on a real store for a month, with about 22,000 visitors. Revenue per visitor was $1.118 with it on and $1.112 with it off, for a net effect of about minus $120.
$120a month
This one went wrong. See what happened before you try it.
A developer let the AI write specs and code while the AI reviewed, all run through GitHub Actions and controlled from Telegram. Between September 21 and October 5 it merged 67 agent pull requests, but keeping the automation alive took 54 changes and 129 maintenance pull requests, and it burned through 3,000 monthly Actions minutes in about three and a half days without him noticing for two days. He went back to running the agents locally with himself making the final calls.
This only partly worked. Worth knowing before you try it.
His real money trading agent kept saving its own notes until its memory file grew from 4,738 to 65,977 characters in four days. One night it retried a failing step 51 times, burned $36.91, and ate 43% of his whole project API spend.
This one went wrong. See what happened before you try it.