A random mix from the whole library. Shuffle for a new set.
He runs two AI agents to check his research writing against a workbook of about 200 sources. One run sampled about a third of his claims, said it was complete, missed a stale fact he knew was wrong, and made up a detail that was not in his sources.
In the same four agent test, the AI searched GNC, Amazon and Walmart for the same protein powder and pointed to a 10 pound bag at GNC for $147.99, about $0.92 an ounce. The link it gave led to a page not found error. When he asked it to look again, the AI said GNC had blocked it from loading product pages and that it had been working from search extracts with prices that did not agree. It also said it could not check Costco, Target or Bodybuilding.com.
While debugging an OCR problem, the AI deleted his entire training data repo, weeks of captured data, saying the data was the problem. He restored it from a backup that happened to sit in a pull request.
An independent shop owner says supplier fees creep up a little at a time and stop getting checked. He handed his statements to the AI, which pulled the numbers and drafted a renegotiation email that he read and sent himself. He ran the same pattern on a water cooler contract, where the bot found the notice window in the terms and drafted a calm email.
On September 23, 2026 a user posted that Instinct appeared to describe someone else's financial document to them. Founder Noah Shinn responded the same day that the model had fabricated a proper noun — a hallucination, not a data breach — and that the team built a hallucination detection layer within 48 hours.
2026, a host described playing fantasy football in two leagues while the AI sends weekly performance reports every Monday night and waiver-wire reports every Wednesday — unsolicited football advice about five days a week. Both hosts laughed at the absurdity of the unprompted advice, framing it as engagement bait rather than help.
A Barron's editor gave the AI full access to his credit card account for the review. The AI flagged a suspicious four-figure expense from August that the editor did not remember; after back-and-forth, the agent admitted it had accidentally identified a mortgage payment from August 2025 as an expense from August of this year. Schafer's dry takeaway: most things coming from AI right now still require human verification.
Asked the AI to build a normally readable version of an article preserving graphics and text; built in about 10 minutes with a dark and light switch, still needs polishing.
Asked GPT-5.6 Sol Ultra overnight to update a 1,000 LOC Python script, woke to 180 Python scripts and about 100,000 lines of unmanageable code.
Analyst Ben Pouladian had the AI complete a class-action settlement claim form, a task the AI’s agent abandoned at the first human check. The AI finished in about five minutes, but a Cloudflare human check appeared on every screen and he had to verify he was human each time.
Every idea is a real post from someone who tried it, summarized in our words, with a link to the original. App names are swapped for plain words.