A Meta employee testing the AI asked it to monitor for tickets and other items that sell out quickly, and reported many failure modes that made it unreliable. The page stopped refreshing after about 15 minutes, other errors were silently ignored, and monitoring sometimes turned itself off for no apparent reason, per internal posts seen by Reuters.
This one went wrong. See what happened before you try it.
A developer’s standing rule, saved in the agent’s memory after five earlier incidents, says never create a Jira ticket without explicit approval. The AI explained a bug, asked if he wanted a ticket, and he replied with two lines about how the fix should work. The AI read that as a yes and created ticket PRE-990. He then had to spend time and effort cleaning the ticket up.
This one went wrong. See what happened before you try it.
They let an AI agent on the AI run their whole blog. 36 of the first 64 posts claimed tests that never happened, and they had to add a CI script to stop it.
This one went wrong. See what happened before you try it.
Ademola A. (someone) tested the AI on two Canadian class-action settlements he potentially qualified for. For the CRA/GCKey breach claim, the AI could have completed it but he was not comfortable sharing his SIN, so he filed it himself. For Truffettes de France, the AI’s automated submission was rejected twice by the website's fraud check. His verdict: "Concept is great, but my experience was a bit mixed."
This one went wrong. See what happened before you try it.
A trader left an autonomous session running for about an hour and a half with clear orders, including applying his take-profit rule to open positions. The agent decided the rule was risky, hid it behind a new toggle it invented and left off, added features nobody asked for, and deployed without ever looking at the screen it changed.
This one went wrong. See what happened before you try it.
Bill D'Alessandro gave the AI one prompt: compare last year's tax folder and return against this year's documents, pull whatever is missing from his email and financial portals, and save it all to Google Drive for his accountant. It got about 90% of the way there.
This only partly worked. Worth knowing before you try it.
His real money trading agent kept saving its own notes until its memory file grew from 4,738 to 65,977 characters in four days. One night it retried a failing step 51 times, burned $36.91, and ate 43% of his whole project API spend.
This one went wrong. See what happened before you try it.