Cargando…

Pilot-job provisioning on grid resources: Collecting analysis and performance evaluation data

To take advantage of the computing power offered by grid and opportunistic resources, the CERN Large Hadron Collider (LHC) experiments have adopted the Pilot-Job paradigm. In this work, we study the DIRAC Site Director, one of the existing Pilot-Job provisioning solutions, mainly developed and used...

Descripción completa

Detalles Bibliográficos
Autores principales: Boyer, Alexandre F., Haen, Christophe, Stagni, Federico, Hill, David R.C.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Elsevier 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9011029/
https://www.ncbi.nlm.nih.gov/pubmed/35434224
http://dx.doi.org/10.1016/j.dib.2022.108104
_version_ 1784687603592724480
author Boyer, Alexandre F.
Haen, Christophe
Stagni, Federico
Hill, David R.C.
author_facet Boyer, Alexandre F.
Haen, Christophe
Stagni, Federico
Hill, David R.C.
author_sort Boyer, Alexandre F.
collection PubMed
description To take advantage of the computing power offered by grid and opportunistic resources, the CERN Large Hadron Collider (LHC) experiments have adopted the Pilot-Job paradigm. In this work, we study the DIRAC Site Director, one of the existing Pilot-Job provisioning solutions, mainly developed and used by the beauty experiment (LHCb). The purpose is to improve the Pilot-Job submission rates and the throughput of the jobs on grid resources. To analyze the DIRAC Site Director mechanisms and assess our contributions, we collected data over 12 months from the LHCbDIRAC instance. We extracted data from the DIRAC databases and the logs. Data include (i) evolution of the number of Pilot-Jobs/jobs over time; (ii) slots available in grid Sites; (iii) number of jobs processed per Pilot-Job.
format Online
Article
Text
id pubmed-9011029
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Elsevier
record_format MEDLINE/PubMed
spelling pubmed-90110292022-04-16 Pilot-job provisioning on grid resources: Collecting analysis and performance evaluation data Boyer, Alexandre F. Haen, Christophe Stagni, Federico Hill, David R.C. Data Brief Data Article To take advantage of the computing power offered by grid and opportunistic resources, the CERN Large Hadron Collider (LHC) experiments have adopted the Pilot-Job paradigm. In this work, we study the DIRAC Site Director, one of the existing Pilot-Job provisioning solutions, mainly developed and used by the beauty experiment (LHCb). The purpose is to improve the Pilot-Job submission rates and the throughput of the jobs on grid resources. To analyze the DIRAC Site Director mechanisms and assess our contributions, we collected data over 12 months from the LHCbDIRAC instance. We extracted data from the DIRAC databases and the logs. Data include (i) evolution of the number of Pilot-Jobs/jobs over time; (ii) slots available in grid Sites; (iii) number of jobs processed per Pilot-Job. Elsevier 2022-03-26 /pmc/articles/PMC9011029/ /pubmed/35434224 http://dx.doi.org/10.1016/j.dib.2022.108104 Text en © 2022 The Authors https://creativecommons.org/licenses/by/4.0/This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Data Article
Boyer, Alexandre F.
Haen, Christophe
Stagni, Federico
Hill, David R.C.
Pilot-job provisioning on grid resources: Collecting analysis and performance evaluation data
title Pilot-job provisioning on grid resources: Collecting analysis and performance evaluation data
title_full Pilot-job provisioning on grid resources: Collecting analysis and performance evaluation data
title_fullStr Pilot-job provisioning on grid resources: Collecting analysis and performance evaluation data
title_full_unstemmed Pilot-job provisioning on grid resources: Collecting analysis and performance evaluation data
title_short Pilot-job provisioning on grid resources: Collecting analysis and performance evaluation data
title_sort pilot-job provisioning on grid resources: collecting analysis and performance evaluation data
topic Data Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9011029/
https://www.ncbi.nlm.nih.gov/pubmed/35434224
http://dx.doi.org/10.1016/j.dib.2022.108104
work_keys_str_mv AT boyeralexandref pilotjobprovisioningongridresourcescollectinganalysisandperformanceevaluationdata
AT haenchristophe pilotjobprovisioningongridresourcescollectinganalysisandperformanceevaluationdata
AT stagnifederico pilotjobprovisioningongridresourcescollectinganalysisandperformanceevaluationdata
AT hilldavidrc pilotjobprovisioningongridresourcescollectinganalysisandperformanceevaluationdata