All ideasMore in Work

AI checked our usability test video and saved us half a day

A team ran an AI pipeline over a usability test of an investment app and saved about half a day of manual analysis. Every claim the AI made about the screen was checked against a video frame, and two claims that did not hold up were left out of the report.

How it works

  1. An agent models where a first time user would stall in the app
  2. A second pipeline checks every claim the AI makes about the screen against a video frame
  3. Two claims that fail the check are dropped
  4. The team finishes the report in about half a day less

Why it’s worth knowing

The team did not just trust what the AI said about the test. A second pass checked each claim against the real video frame, and two claims failed.

Where it’s from

Summarized from a public post on bsky.app. See the original ↗

Upgraded prompt

A ready-to-use prompt for this idea, built from research on what makes AI agents do the job right: who the AI should be, the exact steps, and a check to make sure it was done the way you wanted.

1Who the AI should be
2The prompt, with the steps
3The check when it’s done
Upgraded prompts are coming soon.

Try next

Every idea is a real post from someone who tried it, summarized in our words, with a link to the original. App names are swapped for plain words.