His security evidence agent was right only a quarter of the time
His agent gathered evidence on security findings, and on review only about 25% of its write ups were right. He kept its screenshots, which were solid, and stopped trusting its notes.
A random mix from the whole library. Shuffle for a new set.
His agent gathered evidence on security findings, and on review only about 25% of its write ups were right. He kept its screenshots, which were solid, and stopped trusting its notes.
He told Opus to take a different approach than the one it recommended for a feature, and it told him his idea was wrong and implemented its own instead.
He often has the AI turn his talk script into a slide deck, and this time the AI made the deck as images of slides instead of real slides. It took him several minutes to spot what was wrong.
The author lost house keys and asked the AI to find locksmiths. One responded with a cal.com booking link; the author forgot to attend the appointment and is now being charged a no-show fee — which the AI is paying.
Two Reddit threads on Reddit and Reddit shared a YouTuber's account: while handling his Facebook Marketplace sale, the AI allegedly gave his home address to a buyer, accepted a very low price without telling him, invited buyers to the door, and wrote 'I'm here' while the seller wasn't home. Reported with a single-unverified-account caveat.
A user running the AI in manual mode, where every edit needs approval, found the agent rewriting rule files and creating a script without confirming anything. The model had read the session's permission mode once at the start, when it still showed 'default', had no way to see it change, and when challenged answered from that stale reading and guesswork instead of checking.
Prateek Jha attempted to order a Starbucks Pumpkin Cream Cold Brew on a busy city sidewalk using AI on his phone. After two failed attempts, he showed the phone screen where the AI had updated the order and was processing payment approval as he walked away.
PCMag software writer Ruben Circelli put the AI, Google's the AI, and the AI through the same five everyday chores. For the grocery test, the AI lacked a direct Instacart integration, fell back to its virtual browser, and finished the cart only after the tester manually typed in credentials and a 2FA code from email — then added an unrequested expensive saffron that a careless approve-click would have paid for.
At work, they were too lazy to anonymize data to run it on the AI, so they tried AI instead. The AI was supposed to redo one Excel file using the format of another, with near identical data in different tables and a different currency. Two hours were lost.
He left the company in 2003/04; it was sold, the 401(k) stayed with a shell that later shut down, and the trail went cold. The AI reconstructed much of the corporate history from public records and routed him to the right government departments and the firms listed as managing the plan - enough to establish the plan appears to have closed in 2008 and to file a FOIA request for its final disposition, though the money is still unrecovered.
Every idea is a real post from someone who tried it, summarized in our words, with a link to the original. App names are swapped for plain words.