AI checked our usability test video and saved us half a day
A team ran an AI pipeline over a usability test of an investment app and saved about half a day of manual analysis. Every claim the AI made about the screen was checked against a video frame, and two claims that did not hold up were left out of the report.
How it works
- An agent models where a first time user would stall in the app
- A second pipeline checks every claim the AI makes about the screen against a video frame
- Two claims that fail the check are dropped
- The team finishes the report in about half a day less
Why it’s worth knowing
The team did not just trust what the AI said about the test. A second pass checked each claim against the real video frame, and two claims failed.
Where it’s from
Summarized from a public post on bsky.app. See the original ↗