Cargando…

Exploiting CRIC to streamline the configuration management of GlideinWMS factories for CMS support

GlideinWMS is a workload management and provisioning system that allows sharing computing resources distributed over independent sites. Based on the requests made by GlideinWMS frontends, a dynamically sized pool of resources is created by GlideinWMS pilot factories via pilot job submission to resou...

Descripción completa

Detalles Bibliográficos
Autores principales: Dost, Jeffrey, Mascheroni, Marco, Andreeva, Julia, Anisenkov, Alexey, Box, Dennis, Di Girolamo, Alessandro, Haleem, Saqib, Kizinevič, Edita, Majewski, Krista, Letts, James, Pardavila, Lorena Lobato, Coimbra, Bruno Moreira, Yzquierdo, Antonio Pérez-Calero, Mambelli, Marco, Paparrigopoulos, Panos, Zvada, Marian
Lenguaje:eng
Publicado: 2020
Materias:
Acceso en línea:https://dx.doi.org/10.1051/epjconf/202024503023
http://cds.cern.ch/record/2758811
Descripción
Sumario:GlideinWMS is a workload management and provisioning system that allows sharing computing resources distributed over independent sites. Based on the requests made by GlideinWMS frontends, a dynamically sized pool of resources is created by GlideinWMS pilot factories via pilot job submission to resource sites’ CEs. More than 400 CEs are currently serving more than ten virtual organizations through GlideinWMS, with CMS being the biggest user with 230 CEs. The complex configurations of the parameters defining resource requests, as submitted to those CEs, have been historically managed by manually editing a set of different XML files. New possibilities arise with CMS adopting the CRIC, an information system that collects, aggregates, stores, and exposes, among other things, computing resource data coming from various data providers. The paper will describe the challenges faced when CMS started to use CRIC to automatically generate the GlideinWMS factory configurations. The architecture of the prototype, and the ancillary tools developed to ease this transition, will be discussed. Finally, future plans and milestones will be outlined.