Cargando…

Predicting Job Power Consumption Based on RJMS Submission Data in HPC Systems

Power-aware scheduling is a promising solution to the resource usage monitoring of High-Performance Computing facility electrical power consumption. This kind of solution needs a reliable estimation of job power consumption to feed the Resources and Jobs Management System at submission time. Availab...

Descripción completa

Detalles Bibliográficos
Autores principales: Saillant, Théo, Weill, Jean-Christophe, Mougeot, Mathilde
Formato: Online Artículo Texto
Lenguaje:English
Publicado: 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7295338/
http://dx.doi.org/10.1007/978-3-030-50743-5_4
_version_ 1783546631471235072
author Saillant, Théo
Weill, Jean-Christophe
Mougeot, Mathilde
author_facet Saillant, Théo
Weill, Jean-Christophe
Mougeot, Mathilde
author_sort Saillant, Théo
collection PubMed
description Power-aware scheduling is a promising solution to the resource usage monitoring of High-Performance Computing facility electrical power consumption. This kind of solution needs a reliable estimation of job power consumption to feed the Resources and Jobs Management System at submission time. Available data for inference is restricted in practice because unavailable or even untrustworthy. We propose in this work an instance-based model using only the submission logs and user provided job data. GID and the number of tasks per node appears to be good features for prediction of a job’s average power consumption. Moreover, we extant this model to production context with online computation to make a practical global power prediction from job submission data using instances re-weighting. The performance of the online model are excellent on COBALT’s data. With any doubt this model will be a good candidate for the achievement of consistent power-aware scheduling for other computing centers with similar informative inputs.
format Online
Article
Text
id pubmed-7295338
institution National Center for Biotechnology Information
language English
publishDate 2020
record_format MEDLINE/PubMed
spelling pubmed-72953382020-06-16 Predicting Job Power Consumption Based on RJMS Submission Data in HPC Systems Saillant, Théo Weill, Jean-Christophe Mougeot, Mathilde High Performance Computing Article Power-aware scheduling is a promising solution to the resource usage monitoring of High-Performance Computing facility electrical power consumption. This kind of solution needs a reliable estimation of job power consumption to feed the Resources and Jobs Management System at submission time. Available data for inference is restricted in practice because unavailable or even untrustworthy. We propose in this work an instance-based model using only the submission logs and user provided job data. GID and the number of tasks per node appears to be good features for prediction of a job’s average power consumption. Moreover, we extant this model to production context with online computation to make a practical global power prediction from job submission data using instances re-weighting. The performance of the online model are excellent on COBALT’s data. With any doubt this model will be a good candidate for the achievement of consistent power-aware scheduling for other computing centers with similar informative inputs. 2020-05-22 /pmc/articles/PMC7295338/ http://dx.doi.org/10.1007/978-3-030-50743-5_4 Text en © Springer Nature Switzerland AG 2020 This article is made available via the PMC Open Access Subset for unrestricted research re-use and secondary analysis in any form or by any means with acknowledgement of the original source. These permissions are granted for the duration of the World Health Organization (WHO) declaration of COVID-19 as a global pandemic.
spellingShingle Article
Saillant, Théo
Weill, Jean-Christophe
Mougeot, Mathilde
Predicting Job Power Consumption Based on RJMS Submission Data in HPC Systems
title Predicting Job Power Consumption Based on RJMS Submission Data in HPC Systems
title_full Predicting Job Power Consumption Based on RJMS Submission Data in HPC Systems
title_fullStr Predicting Job Power Consumption Based on RJMS Submission Data in HPC Systems
title_full_unstemmed Predicting Job Power Consumption Based on RJMS Submission Data in HPC Systems
title_short Predicting Job Power Consumption Based on RJMS Submission Data in HPC Systems
title_sort predicting job power consumption based on rjms submission data in hpc systems
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7295338/
http://dx.doi.org/10.1007/978-3-030-50743-5_4
work_keys_str_mv AT saillanttheo predictingjobpowerconsumptionbasedonrjmssubmissiondatainhpcsystems
AT weilljeanchristophe predictingjobpowerconsumptionbasedonrjmssubmissiondatainhpcsystems
AT mougeotmathilde predictingjobpowerconsumptionbasedonrjmssubmissiondatainhpcsystems