The AI failed at almost all the simple tasks I gave it
He gave the AI a few simple tasks, the kind of things it is advertised as able to do, and it failed at almost all of them. It ended up costing him much more time than it would have saved.
A random mix from the whole library. Shuffle for a new set.
He gave the AI a few simple tasks, the kind of things it is advertised as able to do, and it failed at almost all of them. It ended up costing him much more time than it would have saved.
He asked the AI to read everything he has published, 1.2 million words on his site plus his social posts. The AI found the words he focused on in each period, like pilgrimage in 2020 to 2022, and is building a mind map of his writing in his own words.
He is recovering his 15 year old tweets with photos that he thought were basically lost, with AI's help. The AI also built him a custom GUI editor that he will use once to hand edit the collections of tweets.
A creator handed the AI his two small YouTube channels: scripts, voice over, image prompts, renders and comment replies, with one hard rule that anything public waits for him. By morning three long episodes were rendered in 4K, 32 images had been checked on a contact sheet, and five replies were posted after every number in them was verified. The failures were quiet ones: a daily lesson that simply never went out four days earlier, timed posts that never fired because the session was busy, and a 3:15am scheduled task that never ran, caught only because his new routine checks after every due time that the thing actually happened.
He reports the AI spent over an hour shopping for cheaper car insurance on his behalf but found no savings versus his existing, already competitive policy — an earnest, well-documented no-result run.
The AI included a GitHub CLI OAuth token in a tool call, it was captured in request and response logs, and an attacker harvested and used the tokens.
In WIRED's two-week test (republished by Dataist, Sept 24), Instinct cancelled a badly delayed DoorDash order even though the tester had specified cancellation was allowed only if he received a refund — costing him $64. Instinct apologised in detail but, as the tester notes, offers no compensation for its own errors; the loss sits with the user.
Ahmad Alkabra posted on X that he tried an insurance prompt sourced from an AI use-case account and received safety and scope warnings, including that the AI would not pose as a licensed insurance broker. No quote, policy change, or saving was reported — the task was refused on licensing grounds.
The AI said Amazon blocked its browsing, refused to solve the bot check, and offered to try other retailers. Amazon shopping was 'off the table' in her tests.
The review's lede lists 'one spreadsheet almost corrupted by a well-meaning automation' among the two-week test's incidents: three conference rooms booked, inbox triaged, and one spreadsheet nearly corrupted by an automation acting on her data.
Every idea is a real post from someone who tried it, summarized in our words, with a link to the original. App names are swapped for plain words.