Cargando…
Exploiting CRIC to streamline the configuration management of GlideinWMS factories for CMS support
GlideinWMS is a workload management and provisioning system that allows sharing computing resources distributed over independent sites. Based on the requests made by GlideinWMS frontends, a dynamically sized pool of resources is created by GlideinWMS pilot factories via pilot job submission to resou...
Autores principales: | , , , , , , , , , , , , , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2020
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1051/epjconf/202024503023 http://cds.cern.ch/record/2758811 |
_version_ | 1780970193187504128 |
---|---|
author | Dost, Jeffrey Mascheroni, Marco Andreeva, Julia Anisenkov, Alexey Box, Dennis Di Girolamo, Alessandro Haleem, Saqib Kizinevič, Edita Majewski, Krista Letts, James Pardavila, Lorena Lobato Coimbra, Bruno Moreira Yzquierdo, Antonio Pérez-Calero Mambelli, Marco Paparrigopoulos, Panos Zvada, Marian |
author_facet | Dost, Jeffrey Mascheroni, Marco Andreeva, Julia Anisenkov, Alexey Box, Dennis Di Girolamo, Alessandro Haleem, Saqib Kizinevič, Edita Majewski, Krista Letts, James Pardavila, Lorena Lobato Coimbra, Bruno Moreira Yzquierdo, Antonio Pérez-Calero Mambelli, Marco Paparrigopoulos, Panos Zvada, Marian |
author_sort | Dost, Jeffrey |
collection | CERN |
description | GlideinWMS is a workload management and provisioning system that allows sharing computing resources distributed over independent sites. Based on the requests made by GlideinWMS frontends, a dynamically sized pool of resources is created by GlideinWMS pilot factories via pilot job submission to resource sites’ CEs. More than 400 CEs are currently serving more than ten virtual organizations through GlideinWMS, with CMS being the biggest user with 230 CEs. The complex configurations of the parameters defining resource requests, as submitted to those CEs, have been historically managed by manually editing a set of different XML files. New possibilities arise with CMS adopting the CRIC, an information system that collects, aggregates, stores, and exposes, among other things, computing resource data coming from various data providers. The paper will describe the challenges faced when CMS started to use CRIC to automatically generate the GlideinWMS factory configurations. The architecture of the prototype, and the ancillary tools developed to ease this transition, will be discussed. Finally, future plans and milestones will be outlined. |
id | oai-inspirehep.net-1831515 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2020 |
record_format | invenio |
spelling | oai-inspirehep.net-18315152021-03-25T22:33:56Zdoi:10.1051/epjconf/202024503023http://cds.cern.ch/record/2758811engDost, JeffreyMascheroni, MarcoAndreeva, JuliaAnisenkov, AlexeyBox, DennisDi Girolamo, AlessandroHaleem, SaqibKizinevič, EditaMajewski, KristaLetts, JamesPardavila, Lorena LobatoCoimbra, Bruno MoreiraYzquierdo, Antonio Pérez-CaleroMambelli, MarcoPaparrigopoulos, PanosZvada, MarianExploiting CRIC to streamline the configuration management of GlideinWMS factories for CMS supportComputing and ComputersGlideinWMS is a workload management and provisioning system that allows sharing computing resources distributed over independent sites. Based on the requests made by GlideinWMS frontends, a dynamically sized pool of resources is created by GlideinWMS pilot factories via pilot job submission to resource sites’ CEs. More than 400 CEs are currently serving more than ten virtual organizations through GlideinWMS, with CMS being the biggest user with 230 CEs. The complex configurations of the parameters defining resource requests, as submitted to those CEs, have been historically managed by manually editing a set of different XML files. New possibilities arise with CMS adopting the CRIC, an information system that collects, aggregates, stores, and exposes, among other things, computing resource data coming from various data providers. The paper will describe the challenges faced when CMS started to use CRIC to automatically generate the GlideinWMS factory configurations. The architecture of the prototype, and the ancillary tools developed to ease this transition, will be discussed. Finally, future plans and milestones will be outlined.oai:inspirehep.net:18315152020 |
spellingShingle | Computing and Computers Dost, Jeffrey Mascheroni, Marco Andreeva, Julia Anisenkov, Alexey Box, Dennis Di Girolamo, Alessandro Haleem, Saqib Kizinevič, Edita Majewski, Krista Letts, James Pardavila, Lorena Lobato Coimbra, Bruno Moreira Yzquierdo, Antonio Pérez-Calero Mambelli, Marco Paparrigopoulos, Panos Zvada, Marian Exploiting CRIC to streamline the configuration management of GlideinWMS factories for CMS support |
title | Exploiting CRIC to streamline the configuration management of GlideinWMS factories for CMS support |
title_full | Exploiting CRIC to streamline the configuration management of GlideinWMS factories for CMS support |
title_fullStr | Exploiting CRIC to streamline the configuration management of GlideinWMS factories for CMS support |
title_full_unstemmed | Exploiting CRIC to streamline the configuration management of GlideinWMS factories for CMS support |
title_short | Exploiting CRIC to streamline the configuration management of GlideinWMS factories for CMS support |
title_sort | exploiting cric to streamline the configuration management of glideinwms factories for cms support |
topic | Computing and Computers |
url | https://dx.doi.org/10.1051/epjconf/202024503023 http://cds.cern.ch/record/2758811 |
work_keys_str_mv | AT dostjeffrey exploitingcrictostreamlinetheconfigurationmanagementofglideinwmsfactoriesforcmssupport AT mascheronimarco exploitingcrictostreamlinetheconfigurationmanagementofglideinwmsfactoriesforcmssupport AT andreevajulia exploitingcrictostreamlinetheconfigurationmanagementofglideinwmsfactoriesforcmssupport AT anisenkovalexey exploitingcrictostreamlinetheconfigurationmanagementofglideinwmsfactoriesforcmssupport AT boxdennis exploitingcrictostreamlinetheconfigurationmanagementofglideinwmsfactoriesforcmssupport AT digirolamoalessandro exploitingcrictostreamlinetheconfigurationmanagementofglideinwmsfactoriesforcmssupport AT haleemsaqib exploitingcrictostreamlinetheconfigurationmanagementofglideinwmsfactoriesforcmssupport AT kizinevicedita exploitingcrictostreamlinetheconfigurationmanagementofglideinwmsfactoriesforcmssupport AT majewskikrista exploitingcrictostreamlinetheconfigurationmanagementofglideinwmsfactoriesforcmssupport AT lettsjames exploitingcrictostreamlinetheconfigurationmanagementofglideinwmsfactoriesforcmssupport AT pardavilalorenalobato exploitingcrictostreamlinetheconfigurationmanagementofglideinwmsfactoriesforcmssupport AT coimbrabrunomoreira exploitingcrictostreamlinetheconfigurationmanagementofglideinwmsfactoriesforcmssupport AT yzquierdoantonioperezcalero exploitingcrictostreamlinetheconfigurationmanagementofglideinwmsfactoriesforcmssupport AT mambellimarco exploitingcrictostreamlinetheconfigurationmanagementofglideinwmsfactoriesforcmssupport AT paparrigopoulospanos exploitingcrictostreamlinetheconfigurationmanagementofglideinwmsfactoriesforcmssupport AT zvadamarian exploitingcrictostreamlinetheconfigurationmanagementofglideinwmsfactoriesforcmssupport |