Cargando…

ATLAS Event Store and I/O developments in support for Production and Analysis in Run 3

During the long LHC shutdown, ATLAS experiment is preparing several fundamental changes to its offline event processing framework and analysis model. These include moving to multi-threaded reconstruction and simulation and reducing data duplication during derivation analysis by producing a combined...

Descripción completa

Detalles Bibliográficos
Autores principales: Nowak, Marcin, Van Gemmeren, Peter, Cranshaw, Jack
Lenguaje:eng
Publicado: 2020
Materias:
Acceso en línea:https://dx.doi.org/10.1051/epjconf/202024502031
http://cds.cern.ch/record/2710099
_version_ 1780965099122458624
author Nowak, Marcin
Van Gemmeren, Peter
Cranshaw, Jack
author_facet Nowak, Marcin
Van Gemmeren, Peter
Cranshaw, Jack
author_sort Nowak, Marcin
collection CERN
description During the long LHC shutdown, ATLAS experiment is preparing several fundamental changes to its offline event processing framework and analysis model. These include moving to multi-threaded reconstruction and simulation and reducing data duplication during derivation analysis by producing a combined mini-xAOD stream. These changes will allow ATLAS to take advantage of the higher luminosity at Run 3 without overstraining processing and storage capabilities. They also require significant improvements to the underlying event store and the I/O framework to support them. These improvements include: 1) an overhaul of the Run 2 I/O framework to be thread-safe and minimize serial bottlenecks, 2) introduction of new immutable references for object navigation, which don’t rely on storage container entry number so data can be merged in-memory, 3) using filter decisions to annotate combined output stream to allow for fast event selection on input and 4) selecting optimized compression algorithms and settings to allow efficient reading of event selections
id cern-2710099
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2020
record_format invenio
spelling cern-27100992021-03-08T20:51:51Zdoi:10.1051/epjconf/202024502031http://cds.cern.ch/record/2710099engNowak, MarcinVan Gemmeren, PeterCranshaw, JackATLAS Event Store and I/O developments in support for Production and Analysis in Run 3Particle Physics - ExperimentDuring the long LHC shutdown, ATLAS experiment is preparing several fundamental changes to its offline event processing framework and analysis model. These include moving to multi-threaded reconstruction and simulation and reducing data duplication during derivation analysis by producing a combined mini-xAOD stream. These changes will allow ATLAS to take advantage of the higher luminosity at Run 3 without overstraining processing and storage capabilities. They also require significant improvements to the underlying event store and the I/O framework to support them. These improvements include: 1) an overhaul of the Run 2 I/O framework to be thread-safe and minimize serial bottlenecks, 2) introduction of new immutable references for object navigation, which don’t rely on storage container entry number so data can be merged in-memory, 3) using filter decisions to annotate combined output stream to allow for fast event selection on input and 4) selecting optimized compression algorithms and settings to allow efficient reading of event selectionsATL-SOFT-PROC-2020-015oai:cds.cern.ch:27100992020-02-18
spellingShingle Particle Physics - Experiment
Nowak, Marcin
Van Gemmeren, Peter
Cranshaw, Jack
ATLAS Event Store and I/O developments in support for Production and Analysis in Run 3
title ATLAS Event Store and I/O developments in support for Production and Analysis in Run 3
title_full ATLAS Event Store and I/O developments in support for Production and Analysis in Run 3
title_fullStr ATLAS Event Store and I/O developments in support for Production and Analysis in Run 3
title_full_unstemmed ATLAS Event Store and I/O developments in support for Production and Analysis in Run 3
title_short ATLAS Event Store and I/O developments in support for Production and Analysis in Run 3
title_sort atlas event store and i/o developments in support for production and analysis in run 3
topic Particle Physics - Experiment
url https://dx.doi.org/10.1051/epjconf/202024502031
http://cds.cern.ch/record/2710099
work_keys_str_mv AT nowakmarcin atlaseventstoreandiodevelopmentsinsupportforproductionandanalysisinrun3
AT vangemmerenpeter atlaseventstoreandiodevelopmentsinsupportforproductionandanalysisinrun3
AT cranshawjack atlaseventstoreandiodevelopmentsinsupportforproductionandanalysisinrun3