Same Cluster, 33 Points More Utilization: What Changed Was the Order

Hugging Face engineers improved the efficiency of a compute cluster by reordering the sequence of training jobs to reduce idle hardware time. By prioritizing tasks based on specific resource requirements rather than chronological submission, the team achieved a 33-point increase in utilization on existing infrastructure. This approach demonstrates that optimizing job scheduling can significantly enhance throughput without the need for additional hardware investment.