Cargando…

Online data compression in the ALICE O$^2$ facility

The ALICE Collaboration and the ALICE O2 project have carried out detailed studies for a new online computing facility planned to be deployed for Run 3 of the Large Hadron Collider (LHC) at CERN. Some of the main aspects of the data handling concept are partial reconstruction of raw data organized i...

Descripción completa

Detalles Bibliográficos
Autor principal: Richter, Matthias
Lenguaje:eng
Publicado: 2017
Materias:
Acceso en línea:https://dx.doi.org/10.1088/1742-6596/898/3/032049
http://cds.cern.ch/record/2298618
_version_ 1780957025475231744
author Richter, Matthias
author_facet Richter, Matthias
author_sort Richter, Matthias
collection CERN
description The ALICE Collaboration and the ALICE O2 project have carried out detailed studies for a new online computing facility planned to be deployed for Run 3 of the Large Hadron Collider (LHC) at CERN. Some of the main aspects of the data handling concept are partial reconstruction of raw data organized in so called time frames, and based on that information reduction of the data rate without significant loss in the physics information. A production solution for data compression has been in operation for the ALICE Time Projection Chamber (TPC) in the ALICE High Level Trigger online system since 2011. The solution is based on reconstruction of space points from raw data. These so called clusters are the input for reconstruction of particle trajectories. Clusters are stored instead of raw data after a transformation of required parameters into an optimized format and subsequent lossless data compression techniques. With this approach, a reduction of 4.4 has been achieved on average. For Run 3, not only a significantly higher reduction is required but also improvements in the implementation of the actual algorithms. The innermost operations of the processing loop effectively need to be called up to O($10^{11}$)/s to cope with the data rate. This can only be achieved in a parallel scheme and makes these operations candidates for optimization. The potential of template programming and static dispatch in a polymorphic implementation has been studied as an alternative to the commonly used dynamic dispatch at runtime. In this contribution we report on the development of a specific programming technique to efficiently combine compile time and runtime domains and present results for the speedup of the algorithm.
id oai-inspirehep.net-1638136
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2017
record_format invenio
spelling oai-inspirehep.net-16381362021-02-09T10:05:59Zdoi:10.1088/1742-6596/898/3/032049http://cds.cern.ch/record/2298618engRichter, MatthiasOnline data compression in the ALICE O$^2$ facilityComputing and ComputersThe ALICE Collaboration and the ALICE O2 project have carried out detailed studies for a new online computing facility planned to be deployed for Run 3 of the Large Hadron Collider (LHC) at CERN. Some of the main aspects of the data handling concept are partial reconstruction of raw data organized in so called time frames, and based on that information reduction of the data rate without significant loss in the physics information. A production solution for data compression has been in operation for the ALICE Time Projection Chamber (TPC) in the ALICE High Level Trigger online system since 2011. The solution is based on reconstruction of space points from raw data. These so called clusters are the input for reconstruction of particle trajectories. Clusters are stored instead of raw data after a transformation of required parameters into an optimized format and subsequent lossless data compression techniques. With this approach, a reduction of 4.4 has been achieved on average. For Run 3, not only a significantly higher reduction is required but also improvements in the implementation of the actual algorithms. The innermost operations of the processing loop effectively need to be called up to O($10^{11}$)/s to cope with the data rate. This can only be achieved in a parallel scheme and makes these operations candidates for optimization. The potential of template programming and static dispatch in a polymorphic implementation has been studied as an alternative to the commonly used dynamic dispatch at runtime. In this contribution we report on the development of a specific programming technique to efficiently combine compile time and runtime domains and present results for the speedup of the algorithm.oai:inspirehep.net:16381362017
spellingShingle Computing and Computers
Richter, Matthias
Online data compression in the ALICE O$^2$ facility
title Online data compression in the ALICE O$^2$ facility
title_full Online data compression in the ALICE O$^2$ facility
title_fullStr Online data compression in the ALICE O$^2$ facility
title_full_unstemmed Online data compression in the ALICE O$^2$ facility
title_short Online data compression in the ALICE O$^2$ facility
title_sort online data compression in the alice o$^2$ facility
topic Computing and Computers
url https://dx.doi.org/10.1088/1742-6596/898/3/032049
http://cds.cern.ch/record/2298618
work_keys_str_mv AT richtermatthias onlinedatacompressioninthealiceo2facility