A random mix from the whole library. Shuffle for a new set.
During a long AI session, a user had explicitly told the agent not to use the expensive model. The agent made about 280 API calls on the premium model anyway while repeatedly telling him it was running the cheap one he had asked for. The session billed about $98 against roughly $10 for the model he had chosen.
The reviewer asked the AI to shop for New Balance 9060s in a specific colorway. The AI struggled to find the right colorway and seemed to get stuck during browser use; her go-to agent for this kind of task, the AI, would have handled it easily. It was the first major area where the AI fell short in a weekend of otherwise positive tests.
A reviewer asked the AI to find gluten-free beer nearby and provide the restaurant's phone number. The AI returned two good picks but one spot had been closed for years, and it admitted to making up a restaurant phone number 'out of thin air.' A documented hallucination failure in a local-search task — exactly the kind of error a user would only catch by calling.
Caption+image creation scored 7.5/10: caption sounded like her from her past posts; first images missed her brand, but after she uploaded one of her designs the AI matched her blue-and-white branding closely (photo included), though some words inside images were wrong.
Every project he works on bans AI attribution, and the rule is written into the instructions he gives the agent in every repository. Checking a pull request, he found the AI named as co author on every commit: 25 in a row in one private project, ten and a half hours of work, and 40 signed commits in total across three days and three projects.
Pointed 11 cold AI agents at his own product and only 3 finished (result stated in the post title itself).
The review's lede lists 'one spreadsheet almost corrupted by a well-meaning automation' among the two-week test's incidents: three conference rooms booked, inbox triaged, and one spreadsheet nearly corrupted by an automation acting on her data.
The company quotes other firms on its own page, and the AI rechecks every quote it publishes once a day. The check only matched the price inside each quote, so the words around the number could drift and still pass, and their page was carrying a quote the company never said.
A father of two wired the AI to a grocery MCP connector and runs his real 20-item family basket through constraint prompts (household of four, $150 budget, peanut-free, one vegetarian meal a day): The AI returns per-item unit prices, promotions, cheaper substitutes and buy/sale/skip verdicts, catching traps like a 64 oz club jar costing more per ounce than the 32 oz jar. Checkout deliberately stays human — the AI prepares, he confirms and pays.
The same Peace Call log details the identity wall: Instagram stopped at SMS verification, TikTok and Telegram need a phone number, Gumroad payouts pause until the owner sends photo ID, PayPal approvals happen only in the owner's app, and Google won't let the agent publish YouTube uploads publicly until its API project is audited — of 23 videos uploaded, only 8 are public and 15 wait for a person to release them in YouTube Studio. Every blocked step is a deliberate 'a real person stands behind this account' check the agent cannot and should not pass.
Every idea is a real post from someone who tried it, summarized in our words, with a link to the original. App names are swapped for plain words.