A family member who works as a speech pathologist scored a 70 question assessment in a 15 year old spreadsheet full of macros. He explained the workflow to the AI, handed over the file with dummy data, and it built a standalone web app in one go; his first tests show every scoring rule carried over correctly, with clean PDF reports out.
This only partly worked. Worth knowing before you try it.
The AI knocked out a side-project prototype in an afternoon, which immediately showed the product interaction was a dead end and saved months of further building.
This only partly worked. Worth knowing before you try it.
Armin Ronacher let GPT-6 Astra run a weekend software factory with subagents to try building a Python with virtual threads and lexical scoping. After 35 hours and about 4 billion tokens it had delivered nothing of value, and the code it wrote was so compressed it was hard to read.
This one went wrong. See what happened before you try it.
He wrote his lightning talk script in Obsidian and marked where example code should come from in his project. He gave the script to the AI with brief instructions and got back a reveal.js deck that was 95% done.
This only partly worked. Worth knowing before you try it.
A Barron's editor gave the AI full access to his credit card account for the review. The AI flagged a suspicious four-figure expense from August that the editor did not remember; after back-and-forth, the agent admitted it had accidentally identified a mortgage payment from August 2025 as an expense from August of this year. Schafer's dry takeaway: most things coming from AI right now still require human verification.
This one went wrong. See what happened before you try it.
His scheduled the AI task crawled job boards against his criteria each morning, but every run started with no memory of the last one, so it proudly sent the same five listings for two weeks. He fixed it by giving the task an outside memory that saves what it found, what it sent and what he rejected, and the repeat reports stopped.
This only partly worked. Worth knowing before you try it.
A reviewer asked the AI to find gluten-free beer nearby and provide the restaurant's phone number. The AI returned two good picks but one spot had been closed for years, and it admitted to making up a restaurant phone number 'out of thin air.' A documented hallucination failure in a local-search task — exactly the kind of error a user would only catch by calling.
This only partly worked. Worth knowing before you try it.
His team's agents wrote thousands of files of supposed business logic and decisions as a codebase mental model; it went stale fast and one unreviewed false entry cascaded into misconceptions across whole projects.
This one went wrong. See what happened before you try it.
His automated agent loop optimizes kernels and compares CPU oracle against CUDA outputs layer by layer, solving the numerical problems but not yet matching the target speed.
This only partly worked. Worth knowing before you try it.