Reconcile my CSVs — passed three graded runs at $0.48 each
In a screen-recorded benchmark run October 16–17, 2026, the AI was given the same CSV reconciliation task three times in fresh chats and graded against a hidden answer key. It passed all three runs at a median cost of about $0.48 per task at list price.
How it works
- Upload the CSV files in a fresh chat
- Agent reconciles the records
- Output graded against a hidden answer key
- Repeat three times — passed 3 of 3 at a median $0.48 per run
Why it’s worth knowing
The test published a per-task price for finished agent work — under fifty cents a run, three for three.
Where it’s from
Summarized from a public post on pub.towardsai.net. See the original ↗