Machine Learning-Based Runtime Prediction and Energy Optimization for HPC Job Scheduling Using the NREL Eagle Supercomputer Dataset
Renato Quispe-Vargas, Dina Maribel Yana-Yucra, Richar Andre Vilca-Solorzano, Vladimiro Ibañez-Quispe, Fred Torres-Cruz
Informatica — An International Journal of Computing and Informatics (Slovenian Society Informatika)
An analysis of 7.3 million completed jobs from the NREL Eagle supercomputer to predict runtimes with machine learning and optimize energy in HPC job scheduling: users consume a median of only 6.7% of their reserved time, and even under realistic temporal evaluation with concept drift, dynamic time-limit adjustment achieves 64.8% weighted energy savings — an estimated 7.25M kWh and 5,141 metric tons of CO2 per year.
