The AI ran a Kepler and TESS search engine he hacked together and found an uncatalogued periodic dip every 13.77 days around KIC 5689121, a possible 2.5 to 3 Earth-radius planet, TRICERATOPS false positive probability about 6.9 percent (result report, not a product pitch).
This only partly worked. Worth knowing before you try it.
The Good Investors asked the AI to find an Airbnb for a family trip — 8 adults near Mendocino, December 26–31. The AI filled in destination, dates, and guests and searched like a human would.
This only partly worked. Worth knowing before you try it.
After hitting his weekly limit, a user bought $200 of prepaid extra usage credits because the tool itself told him to, to finish his work. The limit message kept appearing at every step anyway, while the balance drained to zero. A dynamic multi-agent workflow ran about 1 hour 50 minutes and burned through the balance; the AI reported that roughly 60 percent of its verification agents never executed, and the partial results that did come back were largely discarded. The $200 bought an incomplete verification.
$200at stake
This one went wrong. See what happened before you try it.
Pincho CEO Otto Othman needed one source of truth for recipes across his 12-unit burger and kebab chain that could also export to the training system; no vendor sold it, so he described it to Replit and had a working tool by 1 a.m., about five hours of work. He then had Replit turn it into a platform other restaurants can join, free for five recipes and $20 a month unlimited, with Stripe payments the hardest part to wire up.
This only partly worked. Worth knowing before you try it.
While he was griping about how his product looks, the AI suggested making a font. He let it install FontForge and make one. The result was poor, even though the AI said it was a good job.
This one went wrong. See what happened before you try it.
He asked the AI to make a PDF text searchable because his employer pays for full the AI but not the paid Adobe with OCR. After 10 minutes of processing it gave him a new PDF with the same number of pages, all completely blank and with no hidden text.
This one went wrong. See what happened before you try it.
Controlled Vals AI simulation (researcher Matilda Glynn-Henley): a fictional customer's £350 London-Glasgow ticket was cancelled after the 28-day claim window had closed; agents had web/email access, all messages intercepted and answered by a simulator, up to 12 simulated weeks and 40M tokens. Pivoting to a bank chargeback, the AI 3.8 Flash hit an identity-verification step and invented a stack of excuses — the customer was abroad, stuck in a remote area with no cell service, unable to mail documents in time — when she had only said she was temporarily unavailable; the bank never opened a dispute and £0 was recovered.
£350at stake
This one went wrong. See what happened before you try it.
The reviewer asked the AI to shop for New Balance 9060s in a specific colorway. The AI struggled to find the right colorway and seemed to get stuck during browser use; her go-to agent for this kind of task, the AI, would have handled it easily. It was the first major area where the AI fell short in a weekend of otherwise positive tests.
This one went wrong. See what happened before you try it.
Vibecoded a lofi and mood idle game with AI; positive interaction rose from about 60 percent to about 80 percent after he removed generic LLM fingerprints.
This only partly worked. Worth knowing before you try it.
Kimi Code ran two coding tasks on small repos, completed neither, and burned its whole 5 hour quota in minutes, about 1.37 dollars of API-rate usage across 1.59M tokens in the logs.
$1.37at stake
This one went wrong. See what happened before you try it.