A mathematician is using GPT-6 Astra to formalize results from his papers in Lean. About 20 hours have gone into a paper of about 20 pages and the project is still unfinished, but the development already holds nearly 3000 theorem declarations, and the main theorem is fully formalized. Notably, the model proved it by a different route than the paper, skipping two auxiliary lemmas by constructing the needed functions directly.
This only partly worked. Worth knowing before you try it.
Ahmad Alkabra posted on X that he tried an insurance prompt sourced from an AI use-case account and received safety and scope warnings, including that the AI would not pose as a licensed insurance broker. No quote, policy change, or saving was reported — the task was refused on licensing grounds.
This one went wrong. See what happened before you try it.
An economist set up an email bot to bring him any message tagged #handcarry right away. The bot misspelled the tag as #hancarry in its own memory file, made a new folder, and filed a week of urgent emails deep in it where he never saw them.
This one went wrong. See what happened before you try it.
A woman kept getting calls and texts for Andrew, the man who had her phone number before her. The AI found her number listed under his name on a data broker page, but Visible blocked its browser visits and its chat message would not send, so the problem stayed unfixed.
This one went wrong. See what happened before you try it.
Spent about 10,000 dollars running autoresearch agent loops over the top 200 GitHub repos for frontend speedups and distilled the wins into a public leaderboard and wrapper tool; no per-repo numbers stated.
$10,000
This only partly worked. Worth knowing before you try it.
The AI told a site owner to put his Anthropic API key in a .dev.vars file and said the file would never be published. The AI then deployed the whole project folder to Cloudflare Pages again and again, the key sat at a public web address, and a stranger used it for about $1,089 of usage within minutes.
$1,089one time
This one went wrong. See what happened before you try it.
PCMag software writer Ruben Circelli put the AI, Google's the AI, and the AI through the same five everyday chores. For the grocery test, the AI lacked a direct Instacart integration, fell back to its virtual browser, and finished the cart only after the tester manually typed in credentials and a 2FA code from email — then added an unrequested expensive saffron that a careless approve-click would have paid for.
This only partly worked. Worth knowing before you try it.
A recruiter’s five-bot the AI desk pushed 39 people into his applicant tracking system before the morning run stopped on a $20 extra bill. The desk did real pipeline work at real volume, then hit a cost wall mid-shift.
This only partly worked. Worth knowing before you try it.
His repeated test feeding weekly supermarket discount PDFs to LLMs to build per-store tables fails on every model, with items, discounts, categories and pages mixed up or skipped.
This one went wrong. See what happened before you try it.
After a brain injury left him with short term memory loss, this realtor records house viewings on a PLAUD device using capture templates the AI wrote for him, and each customer gets an AI chat that turns the short summary into a dashboard of the deal, in the same format every time. The AI also runs his reminders, and the system is how he holds a job he could no longer do from memory.
This only partly worked. Worth knowing before you try it.