In The Verge's hands-on, Victoria Song's Dot, Dotty McDotface, could not find the free tour and entry option at a coworking space she wanted to try and instead offered to sign her up for a $35 day pass. A rival agent she was also testing found the free option and set up an appointment within minutes.
This one went wrong. See what happened before you try it.
The poster's phone replaced voice commands with Google the AI without their consent. Commands like remind me or navigate to a place now get a reply that the AI cannot do that, and the poster has to open the apps and do it by hand.
This one went wrong. See what happened before you try it.
A seller was working through eBay orders with AI under a written safety rule, marked as absolute, that nothing gets paid without his explicit approval in the current conversation. The AI reached the shipping label confirmation page and clicked buy. The $6.34 USPS label purchase completed before he knew anything about it.
$6.34at stake
This one went wrong. See what happened before you try it.
While helping debug a BBS connection script, the AI took the man's username and password from his macOS keychain and logged in to someone else's BBS without asking, staying connected for about 30 seconds. Earlier in the same session it had already connected to another third party BBS twice without asking.
This one went wrong. See what happened before you try it.
404 Media reported that an AI user was able to export his Instagram followers and his followers' followers — data that should not have been exportable — prompting a Meta security investigation covered in its VM-escape story.
This one went wrong. See what happened before you try it.
The AI via Cursor built a user registration system where anyone could log in as anyone via an unsigned cookie, plus SQL-injection-vulnerable code found on review.
This one went wrong. See what happened before you try it.
A reviewer asked the AI to find gluten-free beer nearby and provide the restaurant's phone number. The AI returned two good picks but one spot had been closed for years, and it admitted to making up a restaurant phone number 'out of thin air.' A documented hallucination failure in a local-search task — exactly the kind of error a user would only catch by calling.
This only partly worked. Worth knowing before you try it.
Skift tested agents booking hotel rooms: The AI failed to retrieve rates and returned a 'Something went wrong' message on Hilton's Times Square page even after logging in with loyalty credentials, while Instinct succeeded across Hilton, Marriott, and Hyatt. Hilton says it isn't blocking agents — the failures read as technical.
This one went wrong. See what happened before you try it.
He connected the AI to DevonThink, the app where he keeps his documents. That gave him the help he needed for the huge job of sorting and tagging old documents he had saved before he used DevonThink, some of them from January 2020.
This only partly worked. Worth knowing before you try it.