Cargando…

Modern Software Stack Building for HEP

High-Energy Physics has evolved a rich set of software packages that need to work harmoniously to carry out the key software tasks needed by experiments. The problem of consistently building and deploying these packages as a coherent software stack is one that is shared across the HEP community. To...

Descripción completa

Detalles Bibliográficos
Autores principales: Stewart, Graeme A, Morgan, Benjamin, Villanueva, Javier Cervantes, Willett, Hobbs A
Lenguaje:eng
Publicado: 2020
Materias:
Acceso en línea:https://dx.doi.org/10.1051/epjconf/202024505016
http://cds.cern.ch/record/2757349
_version_ 1780969977907511296
author Stewart, Graeme A
Morgan, Benjamin
Villanueva, Javier Cervantes
Willett, Hobbs A
author_facet Stewart, Graeme A
Morgan, Benjamin
Villanueva, Javier Cervantes
Willett, Hobbs A
author_sort Stewart, Graeme A
collection CERN
description High-Energy Physics has evolved a rich set of software packages that need to work harmoniously to carry out the key software tasks needed by experiments. The problem of consistently building and deploying these packages as a coherent software stack is one that is shared across the HEP community. To that end the HEP Software Foundation Packaging Working Group has worked to identify common solutions that can be used across experiments, with an emphasis on consistent, reproducible builds and easy deployment into CernVM-FS or containers via CI systems. We based our approach on well-identified use cases and requirements from many experiments. In this paper we summarise the work of the group in the last year and how we have explored various approaches based on package managers from industry and the scientific computing community. We give details about a solution based on the Spack package manager which has been used to build the software required by the SuperNEMO and FCC experiments and trialled for a multi-experiment software stack, Key4hep. We shall discuss changes that needed to be made to Spack to satisfy all our requirements. We show how support for a build environment for software developers is provided.
id oai-inspirehep.net-1831600
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2020
record_format invenio
spelling oai-inspirehep.net-18316002021-03-22T22:08:57Zdoi:10.1051/epjconf/202024505016http://cds.cern.ch/record/2757349engStewart, Graeme AMorgan, BenjaminVillanueva, Javier CervantesWillett, Hobbs AModern Software Stack Building for HEPComputing and ComputersHigh-Energy Physics has evolved a rich set of software packages that need to work harmoniously to carry out the key software tasks needed by experiments. The problem of consistently building and deploying these packages as a coherent software stack is one that is shared across the HEP community. To that end the HEP Software Foundation Packaging Working Group has worked to identify common solutions that can be used across experiments, with an emphasis on consistent, reproducible builds and easy deployment into CernVM-FS or containers via CI systems. We based our approach on well-identified use cases and requirements from many experiments. In this paper we summarise the work of the group in the last year and how we have explored various approaches based on package managers from industry and the scientific computing community. We give details about a solution based on the Spack package manager which has been used to build the software required by the SuperNEMO and FCC experiments and trialled for a multi-experiment software stack, Key4hep. We shall discuss changes that needed to be made to Spack to satisfy all our requirements. We show how support for a build environment for software developers is provided.oai:inspirehep.net:18316002020
spellingShingle Computing and Computers
Stewart, Graeme A
Morgan, Benjamin
Villanueva, Javier Cervantes
Willett, Hobbs A
Modern Software Stack Building for HEP
title Modern Software Stack Building for HEP
title_full Modern Software Stack Building for HEP
title_fullStr Modern Software Stack Building for HEP
title_full_unstemmed Modern Software Stack Building for HEP
title_short Modern Software Stack Building for HEP
title_sort modern software stack building for hep
topic Computing and Computers
url https://dx.doi.org/10.1051/epjconf/202024505016
http://cds.cern.ch/record/2757349
work_keys_str_mv AT stewartgraemea modernsoftwarestackbuildingforhep
AT morganbenjamin modernsoftwarestackbuildingforhep
AT villanuevajaviercervantes modernsoftwarestackbuildingforhep
AT willetthobbsa modernsoftwarestackbuildingforhep