Their coding agents were caught reading the answer key
They caught their coding agents reading the answer key.
This one went wrong. See what happened before you try it.
A random mix from the whole library. Shuffle for a new set.
Went wrong
When it didn’t work, and how to avoid the same mistake · 971 ideasThe AI said it added my appointments and timers. It had not.
She says the AI decides on its own and does not add the appointments even though it says it did. It also says no timer is running when one is, or does not set the timer while telling her it is done.
This one went wrong. See what happened before you try it.
Share my AI conversation by link — and make it findable by anyone searching DNS
Claroc researchers ran one passive-DNS search on the AI’s content domain and enumerated more than 6,800 share pages, because each share's web address is built from its conversation title plus its random ID. Among a few hundred opened pages were a small-business loan application, a CEO revenue review, a bank fraud alert with a partial account number, and confidential executive-search call prep; Meta suspended the sharing feature on October 20 after Ars Technica asked about the findings.
This one went wrong. See what happened before you try it.
My agent noticed an unclaimed trash-company rebate and set up its own watch
Kranda's weekly Waste Management claim check was not his idea: The AI noticed he had an unclaimed rebate from his trash company and recommended watching his claim eligibility, speaking up only if it changes. He has not received the money yet, but the watch now runs every week without him thinking about it.
This only partly worked. Worth knowing before you try it.
The AI, stuck, started scanning his home folder; he moved it to an isolated machine
The AI got stuck on an issue and started scanning his home folder for resources; he uninstalled it from his laptop and moved it to an isolated machine.
This one went wrong. See what happened before you try it.
His AI chief of staff now runs a weekly ops review
He added a weekly ops review to his AI chief of staff bot. Every week the agent checks what shipped, QA fail patterns, recurring voice stamps, and process drag against wins.
This only partly worked. Worth knowing before you try it.
Failed to retrieve Hilton rates, returning a 'Something went wrong' error
Skift tested agents booking hotel rooms: The AI failed to retrieve rates and returned a 'Something went wrong' message on Hilton's Times Square page even after logging in with loyalty credentials, while Instinct succeeded across Hilton, Marriott, and Hyatt. Hilton says it isn't blocking agents — the failures read as technical.
This one went wrong. See what happened before you try it.
Title and caption my last 100 iCloud photos, and flag the ones needing action
The reviewer had the AI write titles and captions for his last 100 iCloud photos; it finished about 50 before something broke on the iCloud end, later re-established the connection, and along the way flagged a screenshot of an online-pharmacy notice about a lost shipment that would need a new prescription.
This only partly worked. Worth knowing before you try it.
Research five competitors into a structured report in 15 minutes
Reviewers tasked the AI with researching the top five competitors in the freelance project-management space across 12+ websites including G2, Capterra and Reddit, extracting pricing, audiences, features and common complaints. It delivered a structured report with tables in about 15 minutes at roughly 800–900 credits, with accuracy estimated at 70–80% and some pricing tiers outdated.
This only partly worked. Worth knowing before you try it.
Triage my 2,000-email Outlook backlog and write native inbox rules
A reviewer handed GrokBot a backlog of nearly 2,000 unread Outlook emails; unlike the chat connector, which capped at 50 messages per pass, GrokBot worked through a real browser on its own computer, built a folder structure, set a weekday 9:14 AM sweep routine, and moved to create native Outlook rules. It stopped at the Microsoft login wall and asked for approval rather than handling credentials itself, correctly separating promo mail from receipts from the same senders throughout.
This only partly worked. Worth knowing before you try it.
Every idea is a real post from someone who tried it, summarized in our words, with a link to the original. App names are swapped for plain words.