Cargando…
Writing ROOT data in parallel with TBufferMerger
Experiments at the Large Hadron Collider (LHC) produce tens of petabytes of new data in ROOT format per year that need to be processed and analysed. In the next decade, following the planned upgrades of the LHC and its detectors, this data production rate is expected to increase at least ten-fold. T...
Autores principales: | , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2019
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1051/epjconf/201921405037 http://cds.cern.ch/record/2699852 |
_version_ | 1780964497455841280 |
---|---|
author | Amadio, Guilherme Canal, Philippe Guiraud, Enrico Piparo, Danilo |
author_facet | Amadio, Guilherme Canal, Philippe Guiraud, Enrico Piparo, Danilo |
author_sort | Amadio, Guilherme |
collection | CERN |
description | Experiments at the Large Hadron Collider (LHC) produce tens of petabytes of new data in ROOT format per year that need to be processed and analysed. In the next decade, following the planned upgrades of the LHC and its detectors, this data production rate is expected to increase at least ten-fold. Therefore, optimizing the ROOT I/O subsystem is of critical importance to the success of the LHC physics programme. This contribution presents ROOT’s approach for writing data from multiple threads to a single output file in an efficient way. Technical aspects of the implementation - the TBufferMerger class - and programming model examples are described. Measurements of runtime performance and the overall improvement relative to the case of serial data writing are also discussed. |
id | oai-inspirehep.net-1761257 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2019 |
record_format | invenio |
spelling | oai-inspirehep.net-17612572022-08-10T12:26:17Zdoi:10.1051/epjconf/201921405037http://cds.cern.ch/record/2699852engAmadio, GuilhermeCanal, PhilippeGuiraud, EnricoPiparo, DaniloWriting ROOT data in parallel with TBufferMergerComputing and ComputersExperiments at the Large Hadron Collider (LHC) produce tens of petabytes of new data in ROOT format per year that need to be processed and analysed. In the next decade, following the planned upgrades of the LHC and its detectors, this data production rate is expected to increase at least ten-fold. Therefore, optimizing the ROOT I/O subsystem is of critical importance to the success of the LHC physics programme. This contribution presents ROOT’s approach for writing data from multiple threads to a single output file in an efficient way. Technical aspects of the implementation - the TBufferMerger class - and programming model examples are described. Measurements of runtime performance and the overall improvement relative to the case of serial data writing are also discussed.oai:inspirehep.net:17612572019 |
spellingShingle | Computing and Computers Amadio, Guilherme Canal, Philippe Guiraud, Enrico Piparo, Danilo Writing ROOT data in parallel with TBufferMerger |
title | Writing ROOT data in parallel with TBufferMerger |
title_full | Writing ROOT data in parallel with TBufferMerger |
title_fullStr | Writing ROOT data in parallel with TBufferMerger |
title_full_unstemmed | Writing ROOT data in parallel with TBufferMerger |
title_short | Writing ROOT data in parallel with TBufferMerger |
title_sort | writing root data in parallel with tbuffermerger |
topic | Computing and Computers |
url | https://dx.doi.org/10.1051/epjconf/201921405037 http://cds.cern.ch/record/2699852 |
work_keys_str_mv | AT amadioguilherme writingrootdatainparallelwithtbuffermerger AT canalphilippe writingrootdatainparallelwithtbuffermerger AT guiraudenrico writingrootdatainparallelwithtbuffermerger AT piparodanilo writingrootdatainparallelwithtbuffermerger |