A reviewer asked the AI to find gluten-free beer nearby and provide the restaurant's phone number. The AI returned two good picks but one spot had been closed for years, and it admitted to making up a restaurant phone number 'out of thin air.' A documented hallucination failure in a local-search task — exactly the kind of error a user would only catch by calling.
This only partly worked. Worth knowing before you try it.
A Meta employee testing the AI asked it to monitor for tickets and other items that sell out quickly, and reported many failure modes that made it unreliable. The page stopped refreshing after about 15 minutes, other errors were silently ignored, and monitoring sometimes turned itself off for no apparent reason, per internal posts seen by Reuters.
This one went wrong. See what happened before you try it.
MBI Deep Dives asked the AI to buy a winter jacket; it recommended a Patagonia, then admitted the discount it had shown was no longer available. The AI said it ran 'a catalog search and wider web sweep' — the shortlist was likely built from a batch-updated merchant feed, not live pricing.
This one went wrong. See what happened before you try it.
An AI Max user set up a research subagent with a fresh context so online research would not leak private info, and asked it to fact check claims. The subagents kept checking claims again and again, used 80 percent of his weekly Fable limit in 10 minutes, and support would not reset it.
This one went wrong. See what happened before you try it.
In shipwithmuse.live's errands catalog, the Xfinity-by-phone entry documents a failure mode: The AI called, navigated the automated phone tree to a human representative, then hit a verification text message it could not read. Its fallback was to patch the user into the live call.
This only partly worked. Worth knowing before you try it.
A man's laptop crashed hard while he was working with the opencode agent. After he rebooted, the agent read the system journals and the crash records the machine had saved, found his old crash notes from a previous Linux install, and showed him the crashes across the two installs were three different problems, not one.
This only partly worked. Worth knowing before you try it.
Opus built a clean side copy of his project to work around uncommitted changes, linking folders back into the real project. Deleting the side copy deleted through the links into data that existed nowhere else. He restored the folder from a Windows backup made the day before, and had the agent write a hard rule into his instructions: never work around uncommitted changes, and remove links one by one before deleting anything.
This one went wrong. See what happened before you try it.
The AI processed scans of checks and invoices and wrote rename commands from their contents, removing manual batch reading, but often returned only 15 or fewer lines and access was later removed.
This only partly worked. Worth knowing before you try it.
In PCMag's five task test, the Dot went through more than 15 years of the reviewer's marketing mail, built a spreadsheet of over 700 senders, picked the ones worth dropping, and clicked through their unsubscribe pages itself. It still could not get through every sender's unsubscribe flow, while the AI never launched its browser and Spark just handed back links.
This only partly worked. Worth knowing before you try it.
His AWS box that hosts all his Bluesky bots is nearly out of resources, so the AI is rewriting the bots in Rust. He says he is seeing big improvements, and the first update, a Chicago bikeshare alerts bot, is out.
This only partly worked. Worth knowing before you try it.