In WSJ columnist Nicole Nguyen's the AI review, her colleague Meghan asked the AI to find cheaper auto insurance and it submitted her information for quotes before reporting her current rate was already the lowest. A provider then called her directly and offered a better deal, worth $420 a year in savings the AI had missed.
$420a year
This only partly worked. Worth knowing before you try it.
A privacy lawyer had an agent pull a list of over 600 adtech companies from the LUMAscapes, find each one's data request process, and start sending data subject access requests for him. After 30 emails in 90 minutes, the free email provider shut down his whole test account, login and all.
This one went wrong. See what happened before you try it.
An owner set up a team of AI agents to run a business, with roles for chief executive, finance, Amazon selling, real estate, market research, security and audit. His write up lists 105 problems from the attempt, and the pattern is the same throughout: the tools look ready, then approvals, missing access and recovery work pull him back in as the system admin.
This only partly worked. Worth knowing before you try it.
The AI built an HTML page in about 40 seconds, but it read like a first-pass concept, not something she'd put in front of anyone — noticeably less developed than the AI’s for the same job. Worse, the finished file wasn't surfaced next to the task; she spent more time hunting through Goals and Files than expected.
This only partly worked. Worth knowing before you try it.
He asked the AI to add some dates to his Outlook calendar. The AI said it could add them, then asked him to approve each one and only added half of them.
This only partly worked. Worth knowing before you try it.
Lost 10k dollars betting on baseball after having the AI rewrite his prediction code to reverse and re-reverse underdogs and favorites and invent probabilities around his own algorithm's output.
$10,000at stake
This one went wrong. See what happened before you try it.
Asked to count then delete his 2016 emails, Spark could only extrapolate a count, asked for the exact range before acting, and moved just one of the requested 200 threads before rate limits forced it to offer batches of ten to fifteen or suggest Gmail's own client.
This one went wrong. See what happened before you try it.
Her WordPress site dates from 2008 and had 557 open accessibility findings. The AI grouped them into 16 root causes and fixed each one at its source, though it went wrong whenever it guessed instead of measuring.
This only partly worked. Worth knowing before you try it.
Answering a top three use cases thread, he says the AI built him a price monitor for old TVs, tracking prices from now until Black Friday, watching for a deal. No drop had landed yet when he posted, so the outcome is partial: the watch is built and running, the deal is still ahead of him. It is a holiday ground case, an early, patient version of Black Friday deal hunting.
This only partly worked. Worth knowing before you try it.
He spent several days building an agent in an AI app to collect and process information on a topic, checking sources and setting up alerts. He says it did not work at all.
This one went wrong. See what happened before you try it.