Cargando…

Writing ROOT data in parallel with TBufferMerger

Experiments at the Large Hadron Collider (LHC) produce tens of petabytes of new data in ROOT format per year that need to be processed and analysed. In the next decade, following the planned upgrades of the LHC and its detectors, this data production rate is expected to increase at least ten-fold. T...

Descripción completa

Detalles Bibliográficos
Autores principales: Amadio, Guilherme, Canal, Philippe, Guiraud, Enrico, Piparo, Danilo
Lenguaje:eng
Publicado: 2019
Materias:
Acceso en línea:https://dx.doi.org/10.1051/epjconf/201921405037
http://cds.cern.ch/record/2699852
_version_ 1780964497455841280
author Amadio, Guilherme
Canal, Philippe
Guiraud, Enrico
Piparo, Danilo
author_facet Amadio, Guilherme
Canal, Philippe
Guiraud, Enrico
Piparo, Danilo
author_sort Amadio, Guilherme
collection CERN
description Experiments at the Large Hadron Collider (LHC) produce tens of petabytes of new data in ROOT format per year that need to be processed and analysed. In the next decade, following the planned upgrades of the LHC and its detectors, this data production rate is expected to increase at least ten-fold. Therefore, optimizing the ROOT I/O subsystem is of critical importance to the success of the LHC physics programme. This contribution presents ROOT’s approach for writing data from multiple threads to a single output file in an efficient way. Technical aspects of the implementation - the TBufferMerger class - and programming model examples are described. Measurements of runtime performance and the overall improvement relative to the case of serial data writing are also discussed.
id oai-inspirehep.net-1761257
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2019
record_format invenio
spelling oai-inspirehep.net-17612572022-08-10T12:26:17Zdoi:10.1051/epjconf/201921405037http://cds.cern.ch/record/2699852engAmadio, GuilhermeCanal, PhilippeGuiraud, EnricoPiparo, DaniloWriting ROOT data in parallel with TBufferMergerComputing and ComputersExperiments at the Large Hadron Collider (LHC) produce tens of petabytes of new data in ROOT format per year that need to be processed and analysed. In the next decade, following the planned upgrades of the LHC and its detectors, this data production rate is expected to increase at least ten-fold. Therefore, optimizing the ROOT I/O subsystem is of critical importance to the success of the LHC physics programme. This contribution presents ROOT’s approach for writing data from multiple threads to a single output file in an efficient way. Technical aspects of the implementation - the TBufferMerger class - and programming model examples are described. Measurements of runtime performance and the overall improvement relative to the case of serial data writing are also discussed.oai:inspirehep.net:17612572019
spellingShingle Computing and Computers
Amadio, Guilherme
Canal, Philippe
Guiraud, Enrico
Piparo, Danilo
Writing ROOT data in parallel with TBufferMerger
title Writing ROOT data in parallel with TBufferMerger
title_full Writing ROOT data in parallel with TBufferMerger
title_fullStr Writing ROOT data in parallel with TBufferMerger
title_full_unstemmed Writing ROOT data in parallel with TBufferMerger
title_short Writing ROOT data in parallel with TBufferMerger
title_sort writing root data in parallel with tbuffermerger
topic Computing and Computers
url https://dx.doi.org/10.1051/epjconf/201921405037
http://cds.cern.ch/record/2699852
work_keys_str_mv AT amadioguilherme writingrootdatainparallelwithtbuffermerger
AT canalphilippe writingrootdatainparallelwithtbuffermerger
AT guiraudenrico writingrootdatainparallelwithtbuffermerger
AT piparodanilo writingrootdatainparallelwithtbuffermerger