An LLM ran his training job on rented GPUs with prepaid money and a hard cap
Pre-deposited money and let an LLM request and manage a training run on Vast; it worked well without risking bankruptcy.
How it works
- He pre-deposits money
- Lets the LLM request and manage a training run on a GPU marketplace
- It works well without risking bankruptcy
Why it’s worth knowing
Prepaid is the safety feature: the blast radius was set before the run.
Where it’s from
Summarized from a public post on news.ycombinator.com. See the original ↗