Cargando…

Hyperloop - The ALICE analysis train system for Run 3

ALICE analyses mostly deal with large datasets using the distributed Grid infrastructure. In LHC running periods 1 and 2, ALICE developed a system of analysis trains (so-called “LEGO trains”) that allowed the user to configure analysis tasks (called wagons) that run on the same data. The LEGO train...

Descripción completa

Detalles Bibliográficos
Autores principales: Quishpe, Raquel, Grosse-Oetringhaus, Jan Fiete, Cruceru, Raluca, Grigoras, Costin
Lenguaje:eng
Publicado: 2021
Materias:
Acceso en línea:https://dx.doi.org/10.22323/1.397.0250
http://cds.cern.ch/record/2783492
_version_ 1780972054203334656
author Quishpe, Raquel
Grosse-Oetringhaus, Jan Fiete
Cruceru, Raluca
Grigoras, Costin
author_facet Quishpe, Raquel
Grosse-Oetringhaus, Jan Fiete
Cruceru, Raluca
Grigoras, Costin
author_sort Quishpe, Raquel
collection CERN
description ALICE analyses mostly deal with large datasets using the distributed Grid infrastructure. In LHC running periods 1 and 2, ALICE developed a system of analysis trains (so-called “LEGO trains”) that allowed the user to configure analysis tasks (called wagons) that run on the same data. The LEGO train system builds upon existing tools: the ALICE analysis framework as well as the Grid submission and monitoring infrastructure. This centralized system improved the resource utilization and provided a graphical user interface (UI), in addition to bookkeeping functionalities. Currently, 90$\%$ of ALICE analyses use the train system. The ongoing major upgrade for LHC Run 3 will enable the experiment to cope with an increase of Pb-Pb collision data of two orders of magnitude compared to the Run 1 and 2 data-taking periods. In order to process this unprecedented data sample, a new computing model has been implemented, the Online-Offline Computing System (O$^{2}$). Analysis trains will also be the main workhorse for analysis in Run 3: a new infrastructure, Hyperloop, is being developed based on the successful concept of the LEGO trains. The Hyperloop train system includes a different and improved UI using modern responsive web tools, bookkeeping, instantaneous automatic testing, and the production of derived skimmed data. So far, about 800 Hyperloop trains have been successfully submitted to the Grid and ALICE analysis facilities using converted Run 2 data. An overview of the ALICE train system concept is given, highlighting the improvements of the new Hyperloop framework for analysis in Run 3.
id cern-2783492
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2021
record_format invenio
spelling cern-27834922023-01-31T10:58:32Zdoi:10.22323/1.397.0250http://cds.cern.ch/record/2783492engQuishpe, RaquelGrosse-Oetringhaus, Jan FieteCruceru, RalucaGrigoras, CostinHyperloop - The ALICE analysis train system for Run 3hep-exParticle Physics - Experimentphysics.ins-detDetectors and Experimental TechniquesALICE analyses mostly deal with large datasets using the distributed Grid infrastructure. In LHC running periods 1 and 2, ALICE developed a system of analysis trains (so-called “LEGO trains”) that allowed the user to configure analysis tasks (called wagons) that run on the same data. The LEGO train system builds upon existing tools: the ALICE analysis framework as well as the Grid submission and monitoring infrastructure. This centralized system improved the resource utilization and provided a graphical user interface (UI), in addition to bookkeeping functionalities. Currently, 90$\%$ of ALICE analyses use the train system. The ongoing major upgrade for LHC Run 3 will enable the experiment to cope with an increase of Pb-Pb collision data of two orders of magnitude compared to the Run 1 and 2 data-taking periods. In order to process this unprecedented data sample, a new computing model has been implemented, the Online-Offline Computing System (O$^{2}$). Analysis trains will also be the main workhorse for analysis in Run 3: a new infrastructure, Hyperloop, is being developed based on the successful concept of the LEGO trains. The Hyperloop train system includes a different and improved UI using modern responsive web tools, bookkeeping, instantaneous automatic testing, and the production of derived skimmed data. So far, about 800 Hyperloop trains have been successfully submitted to the Grid and ALICE analysis facilities using converted Run 2 data. An overview of the ALICE train system concept is given, highlighting the improvements of the new Hyperloop framework for analysis in Run 3.ALICE analyses mostly deal with large datasets using the distributed Grid infrastructure. In LHC running periods 1 and 2, ALICE developed a system of analysis trains (so-called $"$LEGO trains$"$) that allowed the user to configure analysis tasks (called wagons) that run on the same data. The LEGO train system builds upon existing tools: the ALICE analysis framework as well as the Grid submission and monitoring infrastructure. This centralized system improved the resource utilization and provided a graphical user interface (UI), in addition to bookkeeping functionalities. Currently, 90$\%$ of ALICE analyses use the train system. The ongoing major upgrade for LHC Run 3 will enable the experiment to cope with an increase of Pb-Pb collision data of two orders of magnitude compared to the Run 1 and 2 data-taking periods. In order to process this unprecedented data sample, a new computing model has been implemented, the Online-Offline Computing System (O$^2$). Analysis trains will also be the main workhorse for analysis in Run 3: a new infrastructure, Hyperloop, is being developed based on the successful concept of the LEGO trains. The Hyperloop train system includes a different and improved UI using modern responsive web tools, bookkeeping, instantaneous automatic testing, and the production of derived skimmed data. So far, about 800 Hyperloop trains have been successfully submitted to the Grid and ALICE analysis facilities using converted Run 2 data. An overview of the ALICE train system concept is given, highlighting the improvements of the new Hyperloop framework for analysis in Run 3.arXiv:2109.09594oai:cds.cern.ch:27834922021-09-20
spellingShingle hep-ex
Particle Physics - Experiment
physics.ins-det
Detectors and Experimental Techniques
Quishpe, Raquel
Grosse-Oetringhaus, Jan Fiete
Cruceru, Raluca
Grigoras, Costin
Hyperloop - The ALICE analysis train system for Run 3
title Hyperloop - The ALICE analysis train system for Run 3
title_full Hyperloop - The ALICE analysis train system for Run 3
title_fullStr Hyperloop - The ALICE analysis train system for Run 3
title_full_unstemmed Hyperloop - The ALICE analysis train system for Run 3
title_short Hyperloop - The ALICE analysis train system for Run 3
title_sort hyperloop - the alice analysis train system for run 3
topic hep-ex
Particle Physics - Experiment
physics.ins-det
Detectors and Experimental Techniques
url https://dx.doi.org/10.22323/1.397.0250
http://cds.cern.ch/record/2783492
work_keys_str_mv AT quishperaquel hyperloopthealiceanalysistrainsystemforrun3
AT grosseoetringhausjanfiete hyperloopthealiceanalysistrainsystemforrun3
AT cruceruraluca hyperloopthealiceanalysistrainsystemforrun3
AT grigorascostin hyperloopthealiceanalysistrainsystemforrun3