Whisper and an LLM rebuilt a 1973 lecture blackboard from tape audio
About 89 hours of tape from Grothendieck's 1973 Buffalo courses surfaced as videos with no blackboard footage. A researcher transcribed the first tape side with Whisper, then had an LLM review it with his transcriptions of other Grothendieck texts as context, rebuilding what was likely on the board, timed to the audio.
How it works
- He transcribes the tape with Whisper
- He gives an LLM his transcriptions of the lecturer's other working notes as context
- The LLM reviews the transcript against that context
- He checks items by hand and against Lean
- The board for the first tape side is rebuilt
Why it’s worth knowing
The board work was never recorded anywhere. Feeding the model the lecturer's own other writings let it reconstruct notation that audio alone does not contain.
Where it’s from
Summarized from a public post on hsm.stackexchange.com. See the original ↗