Cargando…

Exploring GlideinWMS and HTCondor scalability frontiers for an expanding CMS Global Pool

The CMS Submission Infrastructure Global Pool, built on GlideinWMS and HTCondor, is a worldwide distributed dynamic pool responsible forthe allocation of resources for all CMS computing workloads. Matching the continuously increasing demand for computing resources by CMS requires the anticipated ass...

Descripción completa

Detalles Bibliográficos
Autores principales: Pérez-Calero Yzquierdo, Antonio, Bockelman, Brian Paul, Davila Foyo, Diego, Hurtado Anampa, Kenyi, Ivanov, Todor Trendafilov, Khan, Farrukh Aftab, Kotobi, Amjad, Larson, Krista, Letts, James, Mascheroni, Marco, Mason, David
Lenguaje:eng
Publicado: 2019
Materias:
Acceso en línea:https://dx.doi.org/10.1051/epjconf/201921403002
http://cds.cern.ch/record/2701586
_version_ 1780964597118795776
author Pérez-Calero Yzquierdo, Antonio
Bockelman, Brian Paul
Davila Foyo, Diego
Hurtado Anampa, Kenyi
Ivanov, Todor Trendafilov
Khan, Farrukh Aftab
Kotobi, Amjad
Larson, Krista
Letts, James
Mascheroni, Marco
Mason, David
author_facet Pérez-Calero Yzquierdo, Antonio
Bockelman, Brian Paul
Davila Foyo, Diego
Hurtado Anampa, Kenyi
Ivanov, Todor Trendafilov
Khan, Farrukh Aftab
Kotobi, Amjad
Larson, Krista
Letts, James
Mascheroni, Marco
Mason, David
author_sort Pérez-Calero Yzquierdo, Antonio
collection CERN
description The CMS Submission Infrastructure Global Pool, built on GlideinWMS and HTCondor, is a worldwide distributed dynamic pool responsible forthe allocation of resources for all CMS computing workloads. Matching the continuously increasing demand for computing resources by CMS requires the anticipated assessment of its scalability limitations. In addition, the Global Pool must be able to expand in a more heterogeneous environment, in terms of resource provisioning (combining Grid, HPC and Cloud) and workload submission. A dedicated testbed has been set up to simulate such conditions with the purpose of finding potential bottlenecks in the software or its configuration. This report provides a thorough description of the various scalability dimensions in size and complexity that are being explored for the future Global Pool, along with the analysis and solutions to the limitations proposed with the support of the GlideinWMS and HTCondor developer teams.
id oai-inspirehep.net-1760907
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2019
record_format invenio
spelling oai-inspirehep.net-17609072022-08-10T12:26:14Zdoi:10.1051/epjconf/201921403002http://cds.cern.ch/record/2701586engPérez-Calero Yzquierdo, AntonioBockelman, Brian PaulDavila Foyo, DiegoHurtado Anampa, KenyiIvanov, Todor TrendafilovKhan, Farrukh AftabKotobi, AmjadLarson, KristaLetts, JamesMascheroni, MarcoMason, DavidExploring GlideinWMS and HTCondor scalability frontiers for an expanding CMS Global PoolComputing and ComputersThe CMS Submission Infrastructure Global Pool, built on GlideinWMS and HTCondor, is a worldwide distributed dynamic pool responsible forthe allocation of resources for all CMS computing workloads. Matching the continuously increasing demand for computing resources by CMS requires the anticipated assessment of its scalability limitations. In addition, the Global Pool must be able to expand in a more heterogeneous environment, in terms of resource provisioning (combining Grid, HPC and Cloud) and workload submission. A dedicated testbed has been set up to simulate such conditions with the purpose of finding potential bottlenecks in the software or its configuration. This report provides a thorough description of the various scalability dimensions in size and complexity that are being explored for the future Global Pool, along with the analysis and solutions to the limitations proposed with the support of the GlideinWMS and HTCondor developer teams.FERMILAB-CONF-19-553-SCDoai:inspirehep.net:17609072019
spellingShingle Computing and Computers
Pérez-Calero Yzquierdo, Antonio
Bockelman, Brian Paul
Davila Foyo, Diego
Hurtado Anampa, Kenyi
Ivanov, Todor Trendafilov
Khan, Farrukh Aftab
Kotobi, Amjad
Larson, Krista
Letts, James
Mascheroni, Marco
Mason, David
Exploring GlideinWMS and HTCondor scalability frontiers for an expanding CMS Global Pool
title Exploring GlideinWMS and HTCondor scalability frontiers for an expanding CMS Global Pool
title_full Exploring GlideinWMS and HTCondor scalability frontiers for an expanding CMS Global Pool
title_fullStr Exploring GlideinWMS and HTCondor scalability frontiers for an expanding CMS Global Pool
title_full_unstemmed Exploring GlideinWMS and HTCondor scalability frontiers for an expanding CMS Global Pool
title_short Exploring GlideinWMS and HTCondor scalability frontiers for an expanding CMS Global Pool
title_sort exploring glideinwms and htcondor scalability frontiers for an expanding cms global pool
topic Computing and Computers
url https://dx.doi.org/10.1051/epjconf/201921403002
http://cds.cern.ch/record/2701586
work_keys_str_mv AT perezcaleroyzquierdoantonio exploringglideinwmsandhtcondorscalabilityfrontiersforanexpandingcmsglobalpool
AT bockelmanbrianpaul exploringglideinwmsandhtcondorscalabilityfrontiersforanexpandingcmsglobalpool
AT davilafoyodiego exploringglideinwmsandhtcondorscalabilityfrontiersforanexpandingcmsglobalpool
AT hurtadoanampakenyi exploringglideinwmsandhtcondorscalabilityfrontiersforanexpandingcmsglobalpool
AT ivanovtodortrendafilov exploringglideinwmsandhtcondorscalabilityfrontiersforanexpandingcmsglobalpool
AT khanfarrukhaftab exploringglideinwmsandhtcondorscalabilityfrontiersforanexpandingcmsglobalpool
AT kotobiamjad exploringglideinwmsandhtcondorscalabilityfrontiersforanexpandingcmsglobalpool
AT larsonkrista exploringglideinwmsandhtcondorscalabilityfrontiersforanexpandingcmsglobalpool
AT lettsjames exploringglideinwmsandhtcondorscalabilityfrontiersforanexpandingcmsglobalpool
AT mascheronimarco exploringglideinwmsandhtcondorscalabilityfrontiersforanexpandingcmsglobalpool
AT masondavid exploringglideinwmsandhtcondorscalabilityfrontiersforanexpandingcmsglobalpool