Cargando…
Pilot-job provisioning on grid resources: Collecting analysis and performance evaluation data
To take advantage of the computing power offered by grid and opportunistic resources, the CERN Large Hadron Collider (LHC) experiments have adopted the Pilot-Job paradigm. In this work, we study the DIRAC Site Director, one of the existing Pilot-Job provisioning solutions, mainly developed and used...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Elsevier
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9011029/ https://www.ncbi.nlm.nih.gov/pubmed/35434224 http://dx.doi.org/10.1016/j.dib.2022.108104 |
_version_ | 1784687603592724480 |
---|---|
author | Boyer, Alexandre F. Haen, Christophe Stagni, Federico Hill, David R.C. |
author_facet | Boyer, Alexandre F. Haen, Christophe Stagni, Federico Hill, David R.C. |
author_sort | Boyer, Alexandre F. |
collection | PubMed |
description | To take advantage of the computing power offered by grid and opportunistic resources, the CERN Large Hadron Collider (LHC) experiments have adopted the Pilot-Job paradigm. In this work, we study the DIRAC Site Director, one of the existing Pilot-Job provisioning solutions, mainly developed and used by the beauty experiment (LHCb). The purpose is to improve the Pilot-Job submission rates and the throughput of the jobs on grid resources. To analyze the DIRAC Site Director mechanisms and assess our contributions, we collected data over 12 months from the LHCbDIRAC instance. We extracted data from the DIRAC databases and the logs. Data include (i) evolution of the number of Pilot-Jobs/jobs over time; (ii) slots available in grid Sites; (iii) number of jobs processed per Pilot-Job. |
format | Online Article Text |
id | pubmed-9011029 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Elsevier |
record_format | MEDLINE/PubMed |
spelling | pubmed-90110292022-04-16 Pilot-job provisioning on grid resources: Collecting analysis and performance evaluation data Boyer, Alexandre F. Haen, Christophe Stagni, Federico Hill, David R.C. Data Brief Data Article To take advantage of the computing power offered by grid and opportunistic resources, the CERN Large Hadron Collider (LHC) experiments have adopted the Pilot-Job paradigm. In this work, we study the DIRAC Site Director, one of the existing Pilot-Job provisioning solutions, mainly developed and used by the beauty experiment (LHCb). The purpose is to improve the Pilot-Job submission rates and the throughput of the jobs on grid resources. To analyze the DIRAC Site Director mechanisms and assess our contributions, we collected data over 12 months from the LHCbDIRAC instance. We extracted data from the DIRAC databases and the logs. Data include (i) evolution of the number of Pilot-Jobs/jobs over time; (ii) slots available in grid Sites; (iii) number of jobs processed per Pilot-Job. Elsevier 2022-03-26 /pmc/articles/PMC9011029/ /pubmed/35434224 http://dx.doi.org/10.1016/j.dib.2022.108104 Text en © 2022 The Authors https://creativecommons.org/licenses/by/4.0/This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Data Article Boyer, Alexandre F. Haen, Christophe Stagni, Federico Hill, David R.C. Pilot-job provisioning on grid resources: Collecting analysis and performance evaluation data |
title | Pilot-job provisioning on grid resources: Collecting analysis and performance evaluation data |
title_full | Pilot-job provisioning on grid resources: Collecting analysis and performance evaluation data |
title_fullStr | Pilot-job provisioning on grid resources: Collecting analysis and performance evaluation data |
title_full_unstemmed | Pilot-job provisioning on grid resources: Collecting analysis and performance evaluation data |
title_short | Pilot-job provisioning on grid resources: Collecting analysis and performance evaluation data |
title_sort | pilot-job provisioning on grid resources: collecting analysis and performance evaluation data |
topic | Data Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9011029/ https://www.ncbi.nlm.nih.gov/pubmed/35434224 http://dx.doi.org/10.1016/j.dib.2022.108104 |
work_keys_str_mv | AT boyeralexandref pilotjobprovisioningongridresourcescollectinganalysisandperformanceevaluationdata AT haenchristophe pilotjobprovisioningongridresourcescollectinganalysisandperformanceevaluationdata AT stagnifederico pilotjobprovisioningongridresourcescollectinganalysisandperformanceevaluationdata AT hilldavidrc pilotjobprovisioningongridresourcescollectinganalysisandperformanceevaluationdata |