Cargando…
A gateway between GitLab CI and DIRAC
GitLab’s Continuous Integration has proven to be an efficient tool to manage the lifecycle of experimental software. This has sparked interest in uses that exceed simple unit tests, and therefore require more resources, such as production data configuration and physics data analysis. The default Git...
Autores principales: | , |
---|---|
Lenguaje: | eng |
Publicado: |
2020
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1051/epjconf/202024505026 http://cds.cern.ch/record/2752839 |
_version_ | 1780969329965137920 |
---|---|
author | Burr, Chris Couturier, Ben |
author_facet | Burr, Chris Couturier, Ben |
author_sort | Burr, Chris |
collection | CERN |
description | GitLab’s Continuous Integration has proven to be an efficient tool to manage the lifecycle of experimental software. This has sparked interest in uses that exceed simple unit tests, and therefore require more resources, such as production data configuration and physics data analysis. The default GitLab CI runner software is not appropriate for such tasks, and we show that it is possible to use the GitLab API and modern container orchestration technologies to build a custom CI runner that integrates with DIRAC, the middleware used by the LHCb experiment to run its job on the Worldwide LHC Computing Grid. This system allows for excellent utilisation of computing resources while also providing additional flexibility for defining jobs and providing authentication. |
id | oai-inspirehep.net-1832165 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2020 |
record_format | invenio |
spelling | oai-inspirehep.net-18321652021-03-01T20:16:22Zdoi:10.1051/epjconf/202024505026http://cds.cern.ch/record/2752839engBurr, ChrisCouturier, BenA gateway between GitLab CI and DIRACComputing and ComputersGitLab’s Continuous Integration has proven to be an efficient tool to manage the lifecycle of experimental software. This has sparked interest in uses that exceed simple unit tests, and therefore require more resources, such as production data configuration and physics data analysis. The default GitLab CI runner software is not appropriate for such tasks, and we show that it is possible to use the GitLab API and modern container orchestration technologies to build a custom CI runner that integrates with DIRAC, the middleware used by the LHCb experiment to run its job on the Worldwide LHC Computing Grid. This system allows for excellent utilisation of computing resources while also providing additional flexibility for defining jobs and providing authentication.oai:inspirehep.net:18321652020 |
spellingShingle | Computing and Computers Burr, Chris Couturier, Ben A gateway between GitLab CI and DIRAC |
title | A gateway between GitLab CI and DIRAC |
title_full | A gateway between GitLab CI and DIRAC |
title_fullStr | A gateway between GitLab CI and DIRAC |
title_full_unstemmed | A gateway between GitLab CI and DIRAC |
title_short | A gateway between GitLab CI and DIRAC |
title_sort | gateway between gitlab ci and dirac |
topic | Computing and Computers |
url | https://dx.doi.org/10.1051/epjconf/202024505026 http://cds.cern.ch/record/2752839 |
work_keys_str_mv | AT burrchris agatewaybetweengitlabcianddirac AT couturierben agatewaybetweengitlabcianddirac AT burrchris gatewaybetweengitlabcianddirac AT couturierben gatewaybetweengitlabcianddirac |