Cargando…
Fast and Efficient Entropy Compression of ALICE Data using ANS Coding
In LHC Run 3, the upgraded ALICE detector will record 50 kHz Pb-Pb collisions using continuous readout. The resulting stream of raw data to be inspected increases to ~ 1 TB/s a hundredfold increase over Run 2 must be processed with a set of lossy and lossless compression and data reduction technique...
Autor principal: | |
---|---|
Lenguaje: | eng |
Publicado: |
2020
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1051/epjconf/202024501001 http://cds.cern.ch/record/2758822 |
_version_ | 1780970195550994432 |
---|---|
author | Lettrich, Michael |
author_facet | Lettrich, Michael |
author_sort | Lettrich, Michael |
collection | CERN |
description | In LHC Run 3, the upgraded ALICE detector will record 50 kHz Pb-Pb collisions using continuous readout. The resulting stream of raw data to be inspected increases to ~ 1 TB/s a hundredfold increase over Run 2 must be processed with a set of lossy and lossless compression and data reduction techniques to decrease the data rate to storage to 90 GB/s without affecting the physics.This contribution focuses on lossless entropy coding for ALICE Run 3 data which is the final component in the compression stage. We analyze data from the ALICE TPC and point out the challenges imposed by the non-standard data with a patchy distribution and symbol sizes of up to 25 Bit. We then explain why rANS, a variant of Asymmetric Numeral System coders is suitable for compressing this data effectively. Finally we present first compression performance numbers and bandwidth measurements obtained from a prototype implementation and give an outlook for future developments. |
id | oai-inspirehep.net-1831607 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2020 |
record_format | invenio |
spelling | oai-inspirehep.net-18316072021-03-25T22:33:56Zdoi:10.1051/epjconf/202024501001http://cds.cern.ch/record/2758822engLettrich, MichaelFast and Efficient Entropy Compression of ALICE Data using ANS CodingComputing and ComputersIn LHC Run 3, the upgraded ALICE detector will record 50 kHz Pb-Pb collisions using continuous readout. The resulting stream of raw data to be inspected increases to ~ 1 TB/s a hundredfold increase over Run 2 must be processed with a set of lossy and lossless compression and data reduction techniques to decrease the data rate to storage to 90 GB/s without affecting the physics.This contribution focuses on lossless entropy coding for ALICE Run 3 data which is the final component in the compression stage. We analyze data from the ALICE TPC and point out the challenges imposed by the non-standard data with a patchy distribution and symbol sizes of up to 25 Bit. We then explain why rANS, a variant of Asymmetric Numeral System coders is suitable for compressing this data effectively. Finally we present first compression performance numbers and bandwidth measurements obtained from a prototype implementation and give an outlook for future developments.oai:inspirehep.net:18316072020 |
spellingShingle | Computing and Computers Lettrich, Michael Fast and Efficient Entropy Compression of ALICE Data using ANS Coding |
title | Fast and Efficient Entropy Compression of ALICE Data using ANS Coding |
title_full | Fast and Efficient Entropy Compression of ALICE Data using ANS Coding |
title_fullStr | Fast and Efficient Entropy Compression of ALICE Data using ANS Coding |
title_full_unstemmed | Fast and Efficient Entropy Compression of ALICE Data using ANS Coding |
title_short | Fast and Efficient Entropy Compression of ALICE Data using ANS Coding |
title_sort | fast and efficient entropy compression of alice data using ans coding |
topic | Computing and Computers |
url | https://dx.doi.org/10.1051/epjconf/202024501001 http://cds.cern.ch/record/2758822 |
work_keys_str_mv | AT lettrichmichael fastandefficiententropycompressionofalicedatausinganscoding |