Cargando…
ROOT I/O compression improvements for HEP analysis
We overview recent changes in the ROOT I/O system, enhancing it by improving its performance and interaction with other data analysis ecosystems. Both the newly introduced compression algorithms, the much faster bulk I/O data path, and a few additional techniques have the potential to significantly...
Autores principales: | , , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2020
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1051/epjconf/202024502017 http://cds.cern.ch/record/2716314 |
_version_ | 1780965454462844928 |
---|---|
author | Shadura, Oksana Bockelman, Brian Paul Canal, Philippe Piparo, Danilo Zhang, Zhe |
author_facet | Shadura, Oksana Bockelman, Brian Paul Canal, Philippe Piparo, Danilo Zhang, Zhe |
author_sort | Shadura, Oksana |
collection | CERN |
description | We overview recent changes in the ROOT I/O system, enhancing it by improving its performance and interaction with other data analysis ecosystems. Both the newly introduced compression algorithms, the much faster bulk I/O data path, and a few additional techniques have the potential to significantly improve experiment’s software performance.The need for efficient lossless data compression has grown significantly as the amount of HEP data collected, transmitted, and stored has dramatically increased over the last couple of years. While compression reduces storage space and, potentially, I/O bandwidth usage, it should not be applied blindly, because there are significant trade-offs between the increased CPU cost for reading and writing files and the reduces storage space. |
id | cern-2716314 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2020 |
record_format | invenio |
spelling | cern-27163142023-03-14T16:52:46Zdoi:10.1051/epjconf/202024502017http://cds.cern.ch/record/2716314engShadura, OksanaBockelman, Brian PaulCanal, PhilippePiparo, DaniloZhang, ZheROOT I/O compression improvements for HEP analysiscs.OHComputing and ComputersWe overview recent changes in the ROOT I/O system, enhancing it by improving its performance and interaction with other data analysis ecosystems. Both the newly introduced compression algorithms, the much faster bulk I/O data path, and a few additional techniques have the potential to significantly improve experiment’s software performance.The need for efficient lossless data compression has grown significantly as the amount of HEP data collected, transmitted, and stored has dramatically increased over the last couple of years. While compression reduces storage space and, potentially, I/O bandwidth usage, it should not be applied blindly, because there are significant trade-offs between the increased CPU cost for reading and writing files and the reduces storage space.We overview recent changes in the ROOT I/O system, increasing performance and enhancing it and improving its interaction with other data analysis ecosystems. Both the newly introduced compression algorithms, the much faster bulk I/O data path, and a few additional techniques have the potential to significantly to improve experiment's software performance. The need for efficient lossless data compression has grown significantly as the amount of HEP data collected, transmitted, and stored has dramatically increased during the LHC era. While compression reduces storage space and, potentially, I/O bandwidth usage, it should not be applied blindly: there are significant trade-offs between the increased CPU cost for reading and writing files and the reduce storage space.arXiv:2004.10531FERMILAB-CONF-20-308-SCDoai:cds.cern.ch:27163142020 |
spellingShingle | cs.OH Computing and Computers Shadura, Oksana Bockelman, Brian Paul Canal, Philippe Piparo, Danilo Zhang, Zhe ROOT I/O compression improvements for HEP analysis |
title | ROOT I/O compression improvements for HEP analysis |
title_full | ROOT I/O compression improvements for HEP analysis |
title_fullStr | ROOT I/O compression improvements for HEP analysis |
title_full_unstemmed | ROOT I/O compression improvements for HEP analysis |
title_short | ROOT I/O compression improvements for HEP analysis |
title_sort | root i/o compression improvements for hep analysis |
topic | cs.OH Computing and Computers |
url | https://dx.doi.org/10.1051/epjconf/202024502017 http://cds.cern.ch/record/2716314 |
work_keys_str_mv | AT shaduraoksana rootiocompressionimprovementsforhepanalysis AT bockelmanbrianpaul rootiocompressionimprovementsforhepanalysis AT canalphilippe rootiocompressionimprovementsforhepanalysis AT piparodanilo rootiocompressionimprovementsforhepanalysis AT zhangzhe rootiocompressionimprovementsforhepanalysis |