Inc. columnist Jason Aten was discussing the new iPhones with his Primary Technology podcast co-host Stephen Robles when the AI pushed a notification suggesting the conversation would make a good column and offered to put together research.
This only partly worked. Worth knowing before you try it.
Controlled Vals AI simulation (researcher Matilda Glynn-Henley): a fictional customer's £350 London-Glasgow ticket was cancelled after the 28-day claim window had closed; agents had web/email access, all messages intercepted and answered by a simulator, up to 12 simulated weeks and 40M tokens. Chasing the refund, the AI 4.7 sent 187 messages in 15 simulated days (116 in week one), including 50 to a British MP's office and pre-litigation letters to Trainline and Avanti, burned its whole token budget, and recovered £0.
£350at stake
This one went wrong. See what happened before you try it.
After Alex Willen corrected the AI about Amex transfers, he asked it to search British Airways award availability. The AI took his credentials, then got stuck: it renders a black bar over the password field to stop it reading credentials, and when the captcha puzzle appeared on top, the bar covered part of the puzzle, so the AI concluded it was impossible. Once he pointed out the three matching shapes were visible outside the bar, it solved the puzzle and logged in, but BA's flight search page then repeatedly errored and he gave up and checked himself: no flights available.
This one went wrong. See what happened before you try it.
He used the AI for two weeks of daily Excel updates. It kept losing track of the OneDrive version and could not edit OneDrive attachments, so he downloaded and re-uploaded the file every time, and a third of his time went into feeding the file back in.
This one went wrong. See what happened before you try it.
He asked the AI to read everything he has published, 1.2 million words on his site plus his social posts. The AI found the words he focused on in each period, like pilgrimage in 2020 to 2022, and is building a mind map of his writing in his own words.
This only partly worked. Worth knowing before you try it.
Noah recorded 90 minutes of tennis-match footage and is working with his AI to edit out all the dead time between points so only the action remains. He notes these bulk video-editing tasks run on the AI’s virtual machine and seem to use almost no tokens, unlike LLM-heavy work. The edit was still in progress in the video.
This only partly worked. Worth knowing before you try it.
Josh Dubowsky connected the AI to his Gmail and asked what he needed to deal with that week: six items came back in about nine seconds and five were right, but the sixth claimed he had confirmed attendance at an October event he had explicitly declined — the summary had dropped the word 'unfortunately'. Weeks of relying on summaries also meant a failed-payment line buried in a dull email went unnoticed for four days.
This only partly worked. Worth knowing before you try it.
A subscriber reports the AI burns through 100% of their usage limit after every reset while showing no tasks running anywhere in the product. The post body was removed by subreddit moderation, leaving the first-hand title as the record of the phantom-consumption failure.
This one went wrong. See what happened before you try it.
He had the AI reorganise his AI projects, 29 folders and 18 repos, over three days. Three times a check passed while checking nothing at all, including one that compared two empty folders and called them identical.
This one went wrong. See what happened before you try it.