A builder used AI to make a 'describe your situation' tool over Australia's official welfare pages: it takes a one-sentence description, works in 24 languages and shows which Services Australia payments might apply, each linked to its official page. Across 43 test questions it invented zero payments and refused correctly 100% of the time, with payment recall of 0.76.
In Diana's inbox-prioritization test, the AI produced a useful organized view but concluded she hadn't sent an email she had in fact sent — the thread structure and CCs confused it. If she'd trusted the first answer, she'd have sent a duplicate email.
This one went wrong. See what happened before you try it.
He needed to know if a library near him had outlets. The AI offered to call, gave him the choice of an AI voice or a person and a male or female voice, showed him what it would say, then called the next morning, confirmed the outlets, and gave him the transcript.
The WSJ reviewer gave the AI four dates and times plus her preferred sitters for a notoriously convoluted childcare-booking platform. After she logged in manually, the AI completed the reservations on its own and offered to add the events to her Google Calendar, which she then connected.
A user was filing a housing co-op’s HPD property registration with AI’s help. Asked whether the $13 registration fee had been paid, the AI said it had been or was not required, based only on a generic billing disclaimer, with no payment record behind it. Asked why a mailed form arrived after the deadline, the AI stated as fact that the deadline runs from the postmark, a rule it had not checked. Both claims were corrected only after he challenged them. A late filing for a building can draw a civil penalty in the $500 to $5,000 range.
This one went wrong. See what happened before you try it.
His claim was too small for a lawyer and the insurer had frozen it at $4,430, so he worked it himself with AI holding every letter in order. The agent surfaced six dated contradictions in the adjuster's own letters, including a legal basis for denial that changed three times, and reviewed each of his drafts as opposing counsel before anything was sent. After his letter quoting their own paper back at them, the offers climbed: $6,500, then $8,000, then $8,750, and the insurer accepted his split of the last gap the same morning, at $10,250.
She asked the AI if it could cancel her Mint Mobile account. The company's chat agent had told her she needed to call in. She gave the AI her Mint details, the AI opened its own chat with the company and got the cancellation done, with no phone call and no talking to people herself.