Cargando…

ROOT I/O compression improvements for HEP analysis

We overview recent changes in the ROOT I/O system, enhancing it by improving its performance and interaction with other data analysis ecosystems. Both the newly introduced compression algorithms, the much faster bulk I/O data path, and a few additional techniques have the potential to significantly...

Descripción completa

Detalles Bibliográficos
Autores principales: Shadura, Oksana, Bockelman, Brian Paul, Canal, Philippe, Piparo, Danilo, Zhang, Zhe
Lenguaje:eng
Publicado: 2020
Materias:
Acceso en línea:https://dx.doi.org/10.1051/epjconf/202024502017
http://cds.cern.ch/record/2716314
_version_ 1780965454462844928
author Shadura, Oksana
Bockelman, Brian Paul
Canal, Philippe
Piparo, Danilo
Zhang, Zhe
author_facet Shadura, Oksana
Bockelman, Brian Paul
Canal, Philippe
Piparo, Danilo
Zhang, Zhe
author_sort Shadura, Oksana
collection CERN
description We overview recent changes in the ROOT I/O system, enhancing it by improving its performance and interaction with other data analysis ecosystems. Both the newly introduced compression algorithms, the much faster bulk I/O data path, and a few additional techniques have the potential to significantly improve experiment’s software performance.The need for efficient lossless data compression has grown significantly as the amount of HEP data collected, transmitted, and stored has dramatically increased over the last couple of years. While compression reduces storage space and, potentially, I/O bandwidth usage, it should not be applied blindly, because there are significant trade-offs between the increased CPU cost for reading and writing files and the reduces storage space.
id cern-2716314
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2020
record_format invenio
spelling cern-27163142023-03-14T16:52:46Zdoi:10.1051/epjconf/202024502017http://cds.cern.ch/record/2716314engShadura, OksanaBockelman, Brian PaulCanal, PhilippePiparo, DaniloZhang, ZheROOT I/O compression improvements for HEP analysiscs.OHComputing and ComputersWe overview recent changes in the ROOT I/O system, enhancing it by improving its performance and interaction with other data analysis ecosystems. Both the newly introduced compression algorithms, the much faster bulk I/O data path, and a few additional techniques have the potential to significantly improve experiment’s software performance.The need for efficient lossless data compression has grown significantly as the amount of HEP data collected, transmitted, and stored has dramatically increased over the last couple of years. While compression reduces storage space and, potentially, I/O bandwidth usage, it should not be applied blindly, because there are significant trade-offs between the increased CPU cost for reading and writing files and the reduces storage space.We overview recent changes in the ROOT I/O system, increasing performance and enhancing it and improving its interaction with other data analysis ecosystems. Both the newly introduced compression algorithms, the much faster bulk I/O data path, and a few additional techniques have the potential to significantly to improve experiment's software performance. The need for efficient lossless data compression has grown significantly as the amount of HEP data collected, transmitted, and stored has dramatically increased during the LHC era. While compression reduces storage space and, potentially, I/O bandwidth usage, it should not be applied blindly: there are significant trade-offs between the increased CPU cost for reading and writing files and the reduce storage space.arXiv:2004.10531FERMILAB-CONF-20-308-SCDoai:cds.cern.ch:27163142020
spellingShingle cs.OH
Computing and Computers
Shadura, Oksana
Bockelman, Brian Paul
Canal, Philippe
Piparo, Danilo
Zhang, Zhe
ROOT I/O compression improvements for HEP analysis
title ROOT I/O compression improvements for HEP analysis
title_full ROOT I/O compression improvements for HEP analysis
title_fullStr ROOT I/O compression improvements for HEP analysis
title_full_unstemmed ROOT I/O compression improvements for HEP analysis
title_short ROOT I/O compression improvements for HEP analysis
title_sort root i/o compression improvements for hep analysis
topic cs.OH
Computing and Computers
url https://dx.doi.org/10.1051/epjconf/202024502017
http://cds.cern.ch/record/2716314
work_keys_str_mv AT shaduraoksana rootiocompressionimprovementsforhepanalysis
AT bockelmanbrianpaul rootiocompressionimprovementsforhepanalysis
AT canalphilippe rootiocompressionimprovementsforhepanalysis
AT piparodanilo rootiocompressionimprovementsforhepanalysis
AT zhangzhe rootiocompressionimprovementsforhepanalysis