Cargando…

A gateway between GitLab CI and DIRAC

GitLab’s Continuous Integration has proven to be an efficient tool to manage the lifecycle of experimental software. This has sparked interest in uses that exceed simple unit tests, and therefore require more resources, such as production data configuration and physics data analysis. The default Git...

Descripción completa

Detalles Bibliográficos
Autores principales: Burr, Chris, Couturier, Ben
Lenguaje:eng
Publicado: 2020
Materias:
Acceso en línea:https://dx.doi.org/10.1051/epjconf/202024505026
http://cds.cern.ch/record/2752839
_version_ 1780969329965137920
author Burr, Chris
Couturier, Ben
author_facet Burr, Chris
Couturier, Ben
author_sort Burr, Chris
collection CERN
description GitLab’s Continuous Integration has proven to be an efficient tool to manage the lifecycle of experimental software. This has sparked interest in uses that exceed simple unit tests, and therefore require more resources, such as production data configuration and physics data analysis. The default GitLab CI runner software is not appropriate for such tasks, and we show that it is possible to use the GitLab API and modern container orchestration technologies to build a custom CI runner that integrates with DIRAC, the middleware used by the LHCb experiment to run its job on the Worldwide LHC Computing Grid. This system allows for excellent utilisation of computing resources while also providing additional flexibility for defining jobs and providing authentication.
id oai-inspirehep.net-1832165
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2020
record_format invenio
spelling oai-inspirehep.net-18321652021-03-01T20:16:22Zdoi:10.1051/epjconf/202024505026http://cds.cern.ch/record/2752839engBurr, ChrisCouturier, BenA gateway between GitLab CI and DIRACComputing and ComputersGitLab’s Continuous Integration has proven to be an efficient tool to manage the lifecycle of experimental software. This has sparked interest in uses that exceed simple unit tests, and therefore require more resources, such as production data configuration and physics data analysis. The default GitLab CI runner software is not appropriate for such tasks, and we show that it is possible to use the GitLab API and modern container orchestration technologies to build a custom CI runner that integrates with DIRAC, the middleware used by the LHCb experiment to run its job on the Worldwide LHC Computing Grid. This system allows for excellent utilisation of computing resources while also providing additional flexibility for defining jobs and providing authentication.oai:inspirehep.net:18321652020
spellingShingle Computing and Computers
Burr, Chris
Couturier, Ben
A gateway between GitLab CI and DIRAC
title A gateway between GitLab CI and DIRAC
title_full A gateway between GitLab CI and DIRAC
title_fullStr A gateway between GitLab CI and DIRAC
title_full_unstemmed A gateway between GitLab CI and DIRAC
title_short A gateway between GitLab CI and DIRAC
title_sort gateway between gitlab ci and dirac
topic Computing and Computers
url https://dx.doi.org/10.1051/epjconf/202024505026
http://cds.cern.ch/record/2752839
work_keys_str_mv AT burrchris agatewaybetweengitlabcianddirac
AT couturierben agatewaybetweengitlabcianddirac
AT burrchris gatewaybetweengitlabcianddirac
AT couturierben gatewaybetweengitlabcianddirac