Cargando…

Exploiting CRIC to streamline the configuration management of GlideinWMS factories for CMS support

GlideinWMS is a workload management and provisioning system that allows sharing computing resources distributed over independent sites. Based on the requests made by GlideinWMS frontends, a dynamically sized pool of resources is created by GlideinWMS pilot factories via pilot job submission to resou...

Descripción completa

Detalles Bibliográficos
Autores principales: Dost, Jeffrey, Mascheroni, Marco, Andreeva, Julia, Anisenkov, Alexey, Box, Dennis, Di Girolamo, Alessandro, Haleem, Saqib, Kizinevič, Edita, Majewski, Krista, Letts, James, Pardavila, Lorena Lobato, Coimbra, Bruno Moreira, Yzquierdo, Antonio Pérez-Calero, Mambelli, Marco, Paparrigopoulos, Panos, Zvada, Marian
Lenguaje:eng
Publicado: 2020
Materias:
Acceso en línea:https://dx.doi.org/10.1051/epjconf/202024503023
http://cds.cern.ch/record/2758811
_version_ 1780970193187504128
author Dost, Jeffrey
Mascheroni, Marco
Andreeva, Julia
Anisenkov, Alexey
Box, Dennis
Di Girolamo, Alessandro
Haleem, Saqib
Kizinevič, Edita
Majewski, Krista
Letts, James
Pardavila, Lorena Lobato
Coimbra, Bruno Moreira
Yzquierdo, Antonio Pérez-Calero
Mambelli, Marco
Paparrigopoulos, Panos
Zvada, Marian
author_facet Dost, Jeffrey
Mascheroni, Marco
Andreeva, Julia
Anisenkov, Alexey
Box, Dennis
Di Girolamo, Alessandro
Haleem, Saqib
Kizinevič, Edita
Majewski, Krista
Letts, James
Pardavila, Lorena Lobato
Coimbra, Bruno Moreira
Yzquierdo, Antonio Pérez-Calero
Mambelli, Marco
Paparrigopoulos, Panos
Zvada, Marian
author_sort Dost, Jeffrey
collection CERN
description GlideinWMS is a workload management and provisioning system that allows sharing computing resources distributed over independent sites. Based on the requests made by GlideinWMS frontends, a dynamically sized pool of resources is created by GlideinWMS pilot factories via pilot job submission to resource sites’ CEs. More than 400 CEs are currently serving more than ten virtual organizations through GlideinWMS, with CMS being the biggest user with 230 CEs. The complex configurations of the parameters defining resource requests, as submitted to those CEs, have been historically managed by manually editing a set of different XML files. New possibilities arise with CMS adopting the CRIC, an information system that collects, aggregates, stores, and exposes, among other things, computing resource data coming from various data providers. The paper will describe the challenges faced when CMS started to use CRIC to automatically generate the GlideinWMS factory configurations. The architecture of the prototype, and the ancillary tools developed to ease this transition, will be discussed. Finally, future plans and milestones will be outlined.
id oai-inspirehep.net-1831515
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2020
record_format invenio
spelling oai-inspirehep.net-18315152021-03-25T22:33:56Zdoi:10.1051/epjconf/202024503023http://cds.cern.ch/record/2758811engDost, JeffreyMascheroni, MarcoAndreeva, JuliaAnisenkov, AlexeyBox, DennisDi Girolamo, AlessandroHaleem, SaqibKizinevič, EditaMajewski, KristaLetts, JamesPardavila, Lorena LobatoCoimbra, Bruno MoreiraYzquierdo, Antonio Pérez-CaleroMambelli, MarcoPaparrigopoulos, PanosZvada, MarianExploiting CRIC to streamline the configuration management of GlideinWMS factories for CMS supportComputing and ComputersGlideinWMS is a workload management and provisioning system that allows sharing computing resources distributed over independent sites. Based on the requests made by GlideinWMS frontends, a dynamically sized pool of resources is created by GlideinWMS pilot factories via pilot job submission to resource sites’ CEs. More than 400 CEs are currently serving more than ten virtual organizations through GlideinWMS, with CMS being the biggest user with 230 CEs. The complex configurations of the parameters defining resource requests, as submitted to those CEs, have been historically managed by manually editing a set of different XML files. New possibilities arise with CMS adopting the CRIC, an information system that collects, aggregates, stores, and exposes, among other things, computing resource data coming from various data providers. The paper will describe the challenges faced when CMS started to use CRIC to automatically generate the GlideinWMS factory configurations. The architecture of the prototype, and the ancillary tools developed to ease this transition, will be discussed. Finally, future plans and milestones will be outlined.oai:inspirehep.net:18315152020
spellingShingle Computing and Computers
Dost, Jeffrey
Mascheroni, Marco
Andreeva, Julia
Anisenkov, Alexey
Box, Dennis
Di Girolamo, Alessandro
Haleem, Saqib
Kizinevič, Edita
Majewski, Krista
Letts, James
Pardavila, Lorena Lobato
Coimbra, Bruno Moreira
Yzquierdo, Antonio Pérez-Calero
Mambelli, Marco
Paparrigopoulos, Panos
Zvada, Marian
Exploiting CRIC to streamline the configuration management of GlideinWMS factories for CMS support
title Exploiting CRIC to streamline the configuration management of GlideinWMS factories for CMS support
title_full Exploiting CRIC to streamline the configuration management of GlideinWMS factories for CMS support
title_fullStr Exploiting CRIC to streamline the configuration management of GlideinWMS factories for CMS support
title_full_unstemmed Exploiting CRIC to streamline the configuration management of GlideinWMS factories for CMS support
title_short Exploiting CRIC to streamline the configuration management of GlideinWMS factories for CMS support
title_sort exploiting cric to streamline the configuration management of glideinwms factories for cms support
topic Computing and Computers
url https://dx.doi.org/10.1051/epjconf/202024503023
http://cds.cern.ch/record/2758811
work_keys_str_mv AT dostjeffrey exploitingcrictostreamlinetheconfigurationmanagementofglideinwmsfactoriesforcmssupport
AT mascheronimarco exploitingcrictostreamlinetheconfigurationmanagementofglideinwmsfactoriesforcmssupport
AT andreevajulia exploitingcrictostreamlinetheconfigurationmanagementofglideinwmsfactoriesforcmssupport
AT anisenkovalexey exploitingcrictostreamlinetheconfigurationmanagementofglideinwmsfactoriesforcmssupport
AT boxdennis exploitingcrictostreamlinetheconfigurationmanagementofglideinwmsfactoriesforcmssupport
AT digirolamoalessandro exploitingcrictostreamlinetheconfigurationmanagementofglideinwmsfactoriesforcmssupport
AT haleemsaqib exploitingcrictostreamlinetheconfigurationmanagementofglideinwmsfactoriesforcmssupport
AT kizinevicedita exploitingcrictostreamlinetheconfigurationmanagementofglideinwmsfactoriesforcmssupport
AT majewskikrista exploitingcrictostreamlinetheconfigurationmanagementofglideinwmsfactoriesforcmssupport
AT lettsjames exploitingcrictostreamlinetheconfigurationmanagementofglideinwmsfactoriesforcmssupport
AT pardavilalorenalobato exploitingcrictostreamlinetheconfigurationmanagementofglideinwmsfactoriesforcmssupport
AT coimbrabrunomoreira exploitingcrictostreamlinetheconfigurationmanagementofglideinwmsfactoriesforcmssupport
AT yzquierdoantonioperezcalero exploitingcrictostreamlinetheconfigurationmanagementofglideinwmsfactoriesforcmssupport
AT mambellimarco exploitingcrictostreamlinetheconfigurationmanagementofglideinwmsfactoriesforcmssupport
AT paparrigopoulospanos exploitingcrictostreamlinetheconfigurationmanagementofglideinwmsfactoriesforcmssupport
AT zvadamarian exploitingcrictostreamlinetheconfigurationmanagementofglideinwmsfactoriesforcmssupport