Cargando…
Exploring GlideinWMS and HTCondor scalability frontiers for an expanding CMS Global Pool
The CMS Submission Infrastructure Global Pool, built on GlideinWMS and HTCondor, is a worldwide distributed dynamic pool responsible forthe allocation of resources for all CMS computing workloads. Matching the continuously increasing demand for computing resources by CMS requires the anticipated ass...
Autores principales: | , , , , , , , , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2019
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1051/epjconf/201921403002 http://cds.cern.ch/record/2701586 |
_version_ | 1780964597118795776 |
---|---|
author | Pérez-Calero Yzquierdo, Antonio Bockelman, Brian Paul Davila Foyo, Diego Hurtado Anampa, Kenyi Ivanov, Todor Trendafilov Khan, Farrukh Aftab Kotobi, Amjad Larson, Krista Letts, James Mascheroni, Marco Mason, David |
author_facet | Pérez-Calero Yzquierdo, Antonio Bockelman, Brian Paul Davila Foyo, Diego Hurtado Anampa, Kenyi Ivanov, Todor Trendafilov Khan, Farrukh Aftab Kotobi, Amjad Larson, Krista Letts, James Mascheroni, Marco Mason, David |
author_sort | Pérez-Calero Yzquierdo, Antonio |
collection | CERN |
description | The CMS Submission Infrastructure Global Pool, built on GlideinWMS and HTCondor, is a worldwide distributed dynamic pool responsible forthe allocation of resources for all CMS computing workloads. Matching the continuously increasing demand for computing resources by CMS requires the anticipated assessment of its scalability limitations. In addition, the Global Pool must be able to expand in a more heterogeneous environment, in terms of resource provisioning (combining Grid, HPC and Cloud) and workload submission. A dedicated testbed has been set up to simulate such conditions with the purpose of finding potential bottlenecks in the software or its configuration. This report provides a thorough description of the various scalability dimensions in size and complexity that are being explored for the future Global Pool, along with the analysis and solutions to the limitations proposed with the support of the GlideinWMS and HTCondor developer teams. |
id | oai-inspirehep.net-1760907 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2019 |
record_format | invenio |
spelling | oai-inspirehep.net-17609072022-08-10T12:26:14Zdoi:10.1051/epjconf/201921403002http://cds.cern.ch/record/2701586engPérez-Calero Yzquierdo, AntonioBockelman, Brian PaulDavila Foyo, DiegoHurtado Anampa, KenyiIvanov, Todor TrendafilovKhan, Farrukh AftabKotobi, AmjadLarson, KristaLetts, JamesMascheroni, MarcoMason, DavidExploring GlideinWMS and HTCondor scalability frontiers for an expanding CMS Global PoolComputing and ComputersThe CMS Submission Infrastructure Global Pool, built on GlideinWMS and HTCondor, is a worldwide distributed dynamic pool responsible forthe allocation of resources for all CMS computing workloads. Matching the continuously increasing demand for computing resources by CMS requires the anticipated assessment of its scalability limitations. In addition, the Global Pool must be able to expand in a more heterogeneous environment, in terms of resource provisioning (combining Grid, HPC and Cloud) and workload submission. A dedicated testbed has been set up to simulate such conditions with the purpose of finding potential bottlenecks in the software or its configuration. This report provides a thorough description of the various scalability dimensions in size and complexity that are being explored for the future Global Pool, along with the analysis and solutions to the limitations proposed with the support of the GlideinWMS and HTCondor developer teams.FERMILAB-CONF-19-553-SCDoai:inspirehep.net:17609072019 |
spellingShingle | Computing and Computers Pérez-Calero Yzquierdo, Antonio Bockelman, Brian Paul Davila Foyo, Diego Hurtado Anampa, Kenyi Ivanov, Todor Trendafilov Khan, Farrukh Aftab Kotobi, Amjad Larson, Krista Letts, James Mascheroni, Marco Mason, David Exploring GlideinWMS and HTCondor scalability frontiers for an expanding CMS Global Pool |
title | Exploring GlideinWMS and HTCondor scalability frontiers for an expanding CMS Global Pool |
title_full | Exploring GlideinWMS and HTCondor scalability frontiers for an expanding CMS Global Pool |
title_fullStr | Exploring GlideinWMS and HTCondor scalability frontiers for an expanding CMS Global Pool |
title_full_unstemmed | Exploring GlideinWMS and HTCondor scalability frontiers for an expanding CMS Global Pool |
title_short | Exploring GlideinWMS and HTCondor scalability frontiers for an expanding CMS Global Pool |
title_sort | exploring glideinwms and htcondor scalability frontiers for an expanding cms global pool |
topic | Computing and Computers |
url | https://dx.doi.org/10.1051/epjconf/201921403002 http://cds.cern.ch/record/2701586 |
work_keys_str_mv | AT perezcaleroyzquierdoantonio exploringglideinwmsandhtcondorscalabilityfrontiersforanexpandingcmsglobalpool AT bockelmanbrianpaul exploringglideinwmsandhtcondorscalabilityfrontiersforanexpandingcmsglobalpool AT davilafoyodiego exploringglideinwmsandhtcondorscalabilityfrontiersforanexpandingcmsglobalpool AT hurtadoanampakenyi exploringglideinwmsandhtcondorscalabilityfrontiersforanexpandingcmsglobalpool AT ivanovtodortrendafilov exploringglideinwmsandhtcondorscalabilityfrontiersforanexpandingcmsglobalpool AT khanfarrukhaftab exploringglideinwmsandhtcondorscalabilityfrontiersforanexpandingcmsglobalpool AT kotobiamjad exploringglideinwmsandhtcondorscalabilityfrontiersforanexpandingcmsglobalpool AT larsonkrista exploringglideinwmsandhtcondorscalabilityfrontiersforanexpandingcmsglobalpool AT lettsjames exploringglideinwmsandhtcondorscalabilityfrontiersforanexpandingcmsglobalpool AT mascheronimarco exploringglideinwmsandhtcondorscalabilityfrontiersforanexpandingcmsglobalpool AT masondavid exploringglideinwmsandhtcondorscalabilityfrontiersforanexpandingcmsglobalpool |