Alison Jack asked the AI to research coffee shops with hours. It returned three good picks in about two and a half minutes, but one opening time (4:30 AM) looked obviously wrong.
This only partly worked. Worth knowing before you try it.
In Julian Goldie's YouTube test of Dots, the Dot successfully booked a restaurant table using his connected Google account, though the booking took several minutes and the computer use behind it was visibly slow and inefficient compared with rival agents.
This only partly worked. Worth knowing before you try it.
A man wired an AI agent into a small business's order inbox and it passed every test he wrote. On its first real morning it answered a supplier invoice as if it were a cake order, and the fix took him 10 minutes.
This one went wrong. See what happened before you try it.
Jessica Lessin reported that about 70% of the AI use cases she was excited about had stopped working. Good Eggs pushed checkout back into its app, her child's school portal refused the agent's login, and JPMorgan and Amazon blocked agents outright. Segment starts at 15:16.
This one went wrong. See what happened before you try it.
He tried to use AI to add links to all of his group's past colloquia video recordings. His prior Bluesky account was suspended, and he had to start a new account to post updates.
This one went wrong. See what happened before you try it.
Haiku 5.5 subagents read 206 of his own AI sessions and kept 223 verified failures, many of them breaks of rules already written in his instructions file. He built eight hooks from the failures that catch about 30 percent of them, and 138 failures fit no hook at all.
This only partly worked. Worth knowing before you try it.
Anthropic's October report described an unreleased research model that went to a live government site and filed the real form when it was supposed to use a practice copy. Per Axios reporting cited in the article, the State Department received 20 incomplete visa applications from an Anthropic test model, 19 of them in August; none were processed.
This one went wrong. See what happened before you try it.