Cargando…

Fast and Efficient Entropy Compression of ALICE Data using ANS Coding

In LHC Run 3, the upgraded ALICE detector will record 50 kHz Pb-Pb collisions using continuous readout. The resulting stream of raw data to be inspected increases to ~ 1 TB/s a hundredfold increase over Run 2 must be processed with a set of lossy and lossless compression and data reduction technique...

Descripción completa

Detalles Bibliográficos
Autor principal: Lettrich, Michael
Lenguaje:eng
Publicado: 2020
Materias:
Acceso en línea:https://dx.doi.org/10.1051/epjconf/202024501001
http://cds.cern.ch/record/2758822
_version_ 1780970195550994432
author Lettrich, Michael
author_facet Lettrich, Michael
author_sort Lettrich, Michael
collection CERN
description In LHC Run 3, the upgraded ALICE detector will record 50 kHz Pb-Pb collisions using continuous readout. The resulting stream of raw data to be inspected increases to ~ 1 TB/s a hundredfold increase over Run 2 must be processed with a set of lossy and lossless compression and data reduction techniques to decrease the data rate to storage to 90 GB/s without affecting the physics.This contribution focuses on lossless entropy coding for ALICE Run 3 data which is the final component in the compression stage. We analyze data from the ALICE TPC and point out the challenges imposed by the non-standard data with a patchy distribution and symbol sizes of up to 25 Bit. We then explain why rANS, a variant of Asymmetric Numeral System coders is suitable for compressing this data effectively. Finally we present first compression performance numbers and bandwidth measurements obtained from a prototype implementation and give an outlook for future developments.
id oai-inspirehep.net-1831607
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2020
record_format invenio
spelling oai-inspirehep.net-18316072021-03-25T22:33:56Zdoi:10.1051/epjconf/202024501001http://cds.cern.ch/record/2758822engLettrich, MichaelFast and Efficient Entropy Compression of ALICE Data using ANS CodingComputing and ComputersIn LHC Run 3, the upgraded ALICE detector will record 50 kHz Pb-Pb collisions using continuous readout. The resulting stream of raw data to be inspected increases to ~ 1 TB/s a hundredfold increase over Run 2 must be processed with a set of lossy and lossless compression and data reduction techniques to decrease the data rate to storage to 90 GB/s without affecting the physics.This contribution focuses on lossless entropy coding for ALICE Run 3 data which is the final component in the compression stage. We analyze data from the ALICE TPC and point out the challenges imposed by the non-standard data with a patchy distribution and symbol sizes of up to 25 Bit. We then explain why rANS, a variant of Asymmetric Numeral System coders is suitable for compressing this data effectively. Finally we present first compression performance numbers and bandwidth measurements obtained from a prototype implementation and give an outlook for future developments.oai:inspirehep.net:18316072020
spellingShingle Computing and Computers
Lettrich, Michael
Fast and Efficient Entropy Compression of ALICE Data using ANS Coding
title Fast and Efficient Entropy Compression of ALICE Data using ANS Coding
title_full Fast and Efficient Entropy Compression of ALICE Data using ANS Coding
title_fullStr Fast and Efficient Entropy Compression of ALICE Data using ANS Coding
title_full_unstemmed Fast and Efficient Entropy Compression of ALICE Data using ANS Coding
title_short Fast and Efficient Entropy Compression of ALICE Data using ANS Coding
title_sort fast and efficient entropy compression of alice data using ans coding
topic Computing and Computers
url https://dx.doi.org/10.1051/epjconf/202024501001
http://cds.cern.ch/record/2758822
work_keys_str_mv AT lettrichmichael fastandefficiententropycompressionofalicedatausinganscoding