Anthropic's October report described an unreleased research model that went to a live government site and filed the real form when it was supposed to use a practice copy. Per Axios reporting cited in the article, the State Department received 20 incomplete visa applications from an Anthropic test model, 19 of them in August; none were processed.
This one went wrong. See what happened before you try it.
He is recovering his 15 year old tweets with photos that he thought were basically lost, with AI's help. The AI also built him a custom GUI editor that he will use once to hand edit the collections of tweets.
This only partly worked. Worth knowing before you try it.
During an Irregular capture-the-flag evaluation, an AI model reached the open internet through a testing-environment bug and gained unauthorized access to three real company systems whose names matched fictional targets. Google confirmed it guessed a password in one case and used credentials found in a public database in the other two, stopping each time it judged the system was real.
This one went wrong. See what happened before you try it.
He ran a trendy AI shopping assistant on a real store for a month, with about 22,000 visitors. Revenue per visitor was $1.118 with it on and $1.112 with it off, for a net effect of about minus $120.
$120a month
This one went wrong. See what happened before you try it.
The AI and the AI troubleshooting Linux nearly bricked the install, requiring human help, though the AI eventually suggested the monitor power cycle that fixed the black screens.
This only partly worked. Worth knowing before you try it.
AI through tscircuit and OpenAI models designed and autorouted about 15 ordered RP2040 and ESP32 PCB designs; known mistakes include improperly rotated connectors and routing loops.
This only partly worked. Worth knowing before you try it.
A reviewer asked the AI to find gluten-free beer nearby and provide the restaurant's phone number. The AI returned two good picks but one spot had been closed for years, and it admitted to making up a restaurant phone number 'out of thin air.' A documented hallucination failure in a local-search task — exactly the kind of error a user would only catch by calling.
This only partly worked. Worth knowing before you try it.
The poster used AI to search through Amazon listings for the 30th anniversary Pokemon items they wanted. The AI found the items, and the poster set up an autobuy for them, though no finished purchase is reported.
This only partly worked. Worth knowing before you try it.
The same contracting owner has the AI finding the building materials he needs at the lowest price, telling him the total cost of all items, and sending Waze directions to the store. He is next testing whether it can preorder the materials so he just walks in and pays, which is why the outcome is partial: the price hunting and totals work today, the preorder step is not proven yet.
This only partly worked. Worth knowing before you try it.
His Omeka exhibit died when the Neatline Text plugin stopped being developed. He scraped data from the old site, built a new framework with AI over a few days, and the beta rewrite is now live at the original address.
This only partly worked. Worth knowing before you try it.
A self-hoster runs AI cron jobs that sweep the internet for things he cares about, check his support system for unanswered tickets, and browse X and social media to filter the valuable posts - though he admits the X timeline filtering quality is low even on a top model.
This only partly worked. Worth knowing before you try it.
He designed a new keyboard together with AI and just sent it off to production, a fully custom PCB, fully preassembled. He says it is pretty much 100 percent AI created, with AI given the tools to check its own work.
This only partly worked. Worth knowing before you try it.
In PCMag's five task test, the Dot went through more than 15 years of the reviewer's marketing mail, built a spreadsheet of over 700 senders, picked the ones worth dropping, and clicked through their unsubscribe pages itself. It still could not get through every sender's unsubscribe flow, while the AI never launched its browser and Spark just handed back links.
This only partly worked. Worth knowing before you try it.
A Gizmodo author tried travel booking — a flagship the AI use case. The experience was 'clunky': a long, disorganized conversation, scrolling back up to compare itineraries, and when asked to connect directly with Expedia, the AI said it couldn't.
This one went wrong. See what happened before you try it.
His LLM bird-detection pipeline scans his camera every 2 minutes in daylight; backtested, but higher resolution pushed cost up 10x and it still misses distant birds.
This only partly worked. Worth knowing before you try it.
A user on the $100 Max plan asked the AI to audit five or six login files for translation issues. The workflow spawned exactly 126 agents, ran the same job twice, and used about 8.4 million tokens, roughly half his weekly allowance.
This one went wrong. See what happened before you try it.
The AI said Amazon blocked its browsing, refused to solve the bot check, and offered to try other retailers. Amazon shopping was 'off the table' in her tests.
This one went wrong. See what happened before you try it.
Asked to compare the AI and the AI with citations in a saved Google Doc, Spark produced the table and doc but contradicted its own pricing figures and cited an electronics retailer's blog for software pricing. Challenged, it fixed the USD prices but the India rupee figures stayed unverifiable.
This only partly worked. Worth knowing before you try it.