The AI built his rhythm game charting tool, timing vocals from the songs themselves
The AI built an automatic Clone Hero charting solution, ripping audio from YouTube and using Whisper to time vocals.
How it works
- The AI builds an automatic charting solution
- Rips audio from YouTube
- Uses a transcription model to time the vocals
- Charts come out ready to play
Why it’s worth knowing
Timing vocals by ear is the slow craft this removes.
Where it’s from
Summarized from a public post on news.ycombinator.com. See the original ↗