Problem
Design a GPU scheduling platform that queues ML jobs, assigns them to nodes, and handles execution failures
- Keep placement state consistent across the scheduler, database, and agent when assignments fail mid-flight
- Preempt lower-priority work quickly without starving normal jobs
- Detect dead nodes fast enough to retry, but slow enough to skip transient blips
Key Test Points
- Lease protocol
- Priority aging with preemption protection
- Two-tier heartbeat detection
Spot an issue or have a suggestion?