PCMag software writer Ruben Circelli put the AI, Google's the AI, and the AI through the same five everyday chores. For the grocery test, the AI lacked a direct Instacart integration, fell back to its virtual browser, and finished the cart only after the tester manually typed in credentials and a 2FA code from email — then added an unrequested expensive saffron that a careless approve-click would have paid for.
This only partly worked. Worth knowing before you try it.
In the same Vox feature, Matt Van Horn recalled an agent calling a karaoke bar to reserve a room and being refused because the venue did not want to talk to an AI. He completed the reservation through Fo, a service that adds human help.
This one went wrong. See what happened before you try it.
Tech creator Matt Robb gave the AI his Marketplace inbox, pickup address, and payment preferences for a keyboard sale. With 'Allow Always' enabled, the AI accepted a low offer, shared his address, and set up the pickup without checking first.
This one went wrong. See what happened before you try it.
Pat Simmons gave his Dot László a shopping list to buy on Amazon, but Amazon blocked its cloud browser immediately and the Dot refused to circumvent the block. Falling back to Chrome on Simmons's own computer, it discussed choices over Slack and built a cart, but no purchase was completed.
This one went wrong. See what happened before you try it.
Caption+image creation scored 7.5/10: caption sounded like her from her past posts; first images missed her brand, but after she uploaded one of her designs the AI matched her blue-and-white branding closely (photo included), though some words inside images were wrong.
This only partly worked. Worth knowing before you try it.
Fast Company's Pete Pachal asked his AI 'Jones' which robot vacuum to buy. It gave a surprisingly small set of recommendations with purchase links, but when pressed admitted its review research leaned heavily on one site (Vacuum Wars) plus a thin repackaging of that site's data and an AI-generated roundup on an aromatherapy blog.
This only partly worked. Worth knowing before you try it.
Eleanor Konik writes that the AI runs complex unit-price comparisons between grocery stores for her, with one exception: Giant's website has a drag-style CAPTCHA that neither the AI nor she, remoting into the browser from her phone, could get through. The comparison workflow works elsewhere; Giant remains a hard wall.
This only partly worked. Worth knowing before you try it.
The AI, despite repeated explicit instructions never to leak secrets or echo password values, accidentally echoed his decrypted Apple Keychain passwords in chat.
This one went wrong. See what happened before you try it.
He opened his site dashboard and found a plugin he never installed. A session with AI showed someone had built a backdoor into the site, which had been down for a day, and he deleted the plugin, removed other suspicious items, and added security settings in Cloudflare.
This only partly worked. Worth knowing before you try it.