Cargando…

Reaching new peaks for the future of the CMS HTCondor Global Pool

<!--HTML-->The CMS experiment at CERN employs a distributed computing infrastructure to satisfy its data processing and simulation needs. The CMS Submission Infrastructure team manages a dynamic HTCondor pool, aggregating mainly Grid clusters worldwide, but also HPC, Cloud and opportunistic re...

Descripción completa

Detalles Bibliográficos
Autor principal: Perez-Calero Yzquierdo, Antonio
Lenguaje:eng
Publicado: 2021
Materias:
Acceso en línea:http://cds.cern.ch/record/2767069
_version_ 1780971267290038272
author Perez-Calero Yzquierdo, Antonio
author_facet Perez-Calero Yzquierdo, Antonio
author_sort Perez-Calero Yzquierdo, Antonio
collection CERN
description <!--HTML-->The CMS experiment at CERN employs a distributed computing infrastructure to satisfy its data processing and simulation needs. The CMS Submission Infrastructure team manages a dynamic HTCondor pool, aggregating mainly Grid clusters worldwide, but also HPC, Cloud and opportunistic resources. This CMS Global Pool, which currently involves over 70 computing sites worldwide and peaks at 300k CPU cores, is capable of successfully handling the simultaneous execution of up to 150k tasks. While the present infrastructure is sufficient to harness the current computing power scales, CMS latest estimates predict that at least a four-time increase in the total amount of CPU will be required in order to cope with the massive data increase of the High-Luminosity LHC (HL-LHC) era, planned to start in 2027. This contribution presents the latest results of the CMS Submission Infrastructure team in exploring the scalability reach of our Global Pool, in order to preventively detect and overcome any barriers in relation to the HL-LHC goals, while maintaining high efficiency in our workload scheduling and resource utilization.
id cern-2767069
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2021
record_format invenio
spelling cern-27670692022-11-02T22:25:41Zhttp://cds.cern.ch/record/2767069engPerez-Calero Yzquierdo, AntonioReaching new peaks for the future of the CMS HTCondor Global Pool25th International Conference on Computing in High Energy & Nuclear PhysicsConferences<!--HTML-->The CMS experiment at CERN employs a distributed computing infrastructure to satisfy its data processing and simulation needs. The CMS Submission Infrastructure team manages a dynamic HTCondor pool, aggregating mainly Grid clusters worldwide, but also HPC, Cloud and opportunistic resources. This CMS Global Pool, which currently involves over 70 computing sites worldwide and peaks at 300k CPU cores, is capable of successfully handling the simultaneous execution of up to 150k tasks. While the present infrastructure is sufficient to harness the current computing power scales, CMS latest estimates predict that at least a four-time increase in the total amount of CPU will be required in order to cope with the massive data increase of the High-Luminosity LHC (HL-LHC) era, planned to start in 2027. This contribution presents the latest results of the CMS Submission Infrastructure team in exploring the scalability reach of our Global Pool, in order to preventively detect and overcome any barriers in relation to the HL-LHC goals, while maintaining high efficiency in our workload scheduling and resource utilization.oai:cds.cern.ch:27670692021
spellingShingle Conferences
Perez-Calero Yzquierdo, Antonio
Reaching new peaks for the future of the CMS HTCondor Global Pool
title Reaching new peaks for the future of the CMS HTCondor Global Pool
title_full Reaching new peaks for the future of the CMS HTCondor Global Pool
title_fullStr Reaching new peaks for the future of the CMS HTCondor Global Pool
title_full_unstemmed Reaching new peaks for the future of the CMS HTCondor Global Pool
title_short Reaching new peaks for the future of the CMS HTCondor Global Pool
title_sort reaching new peaks for the future of the cms htcondor global pool
topic Conferences
url http://cds.cern.ch/record/2767069
work_keys_str_mv AT perezcaleroyzquierdoantonio reachingnewpeaksforthefutureofthecmshtcondorglobalpool
AT perezcaleroyzquierdoantonio 25thinternationalconferenceoncomputinginhighenergynuclearphysics