Cargando…

ATLAS Event Store and I/O developments in support for Production and Analysis in Run 3

During the long shutdown, ATLAS is preparing several fundamental changes to its offline event processing framework and analysis model. These include moving to multi-threaded reconstruction and simulation and reducing data duplication during derivation analysis by producing a combined mini-xAOD strea...

Descripción completa

Detalles Bibliográficos
Autores principales: Nowak, Marcin, Van Gemmeren, Peter, Cranshaw, Jack
Lenguaje:eng
Publicado: 2019
Materias:
Acceso en línea:http://cds.cern.ch/record/2694039
_version_ 1780964064518733824
author Nowak, Marcin
Van Gemmeren, Peter
Cranshaw, Jack
author_facet Nowak, Marcin
Van Gemmeren, Peter
Cranshaw, Jack
author_sort Nowak, Marcin
collection CERN
description During the long shutdown, ATLAS is preparing several fundamental changes to its offline event processing framework and analysis model. These include moving to multi-threaded reconstruction and simulation and reducing data duplication during derivation analysis by producing a combined mini-xAOD stream. These changes will allow ATLAS to take advantage of the higher luminosity at Run 3 without overstraining processing and storage capabilities. They also require significant changes to the underlying event store and the I/O framework to support them. These changes and their effects are discussed in the presentation: * The Run 2 I/O framework was overhauled to be thread-safe and minimize serial bottlenecks. * For object navigation, new immutable references are deployed, which don’t rely on storage container entry number so data can be merged in-memory. * Filter decisions can be used to annotate combined output stream allowing for fast event selection on input. * Compression algorithms and settings were optimized to allow efficient reading of event selections.
id cern-2694039
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2019
record_format invenio
spelling cern-26940392019-10-18T18:44:08Zhttp://cds.cern.ch/record/2694039engNowak, MarcinVan Gemmeren, PeterCranshaw, JackATLAS Event Store and I/O developments in support for Production and Analysis in Run 3Particle Physics - ExperimentDuring the long shutdown, ATLAS is preparing several fundamental changes to its offline event processing framework and analysis model. These include moving to multi-threaded reconstruction and simulation and reducing data duplication during derivation analysis by producing a combined mini-xAOD stream. These changes will allow ATLAS to take advantage of the higher luminosity at Run 3 without overstraining processing and storage capabilities. They also require significant changes to the underlying event store and the I/O framework to support them. These changes and their effects are discussed in the presentation: * The Run 2 I/O framework was overhauled to be thread-safe and minimize serial bottlenecks. * For object navigation, new immutable references are deployed, which don’t rely on storage container entry number so data can be merged in-memory. * Filter decisions can be used to annotate combined output stream allowing for fast event selection on input. * Compression algorithms and settings were optimized to allow efficient reading of event selections.ATL-SOFT-SLIDE-2019-777oai:cds.cern.ch:26940392019-10-18
spellingShingle Particle Physics - Experiment
Nowak, Marcin
Van Gemmeren, Peter
Cranshaw, Jack
ATLAS Event Store and I/O developments in support for Production and Analysis in Run 3
title ATLAS Event Store and I/O developments in support for Production and Analysis in Run 3
title_full ATLAS Event Store and I/O developments in support for Production and Analysis in Run 3
title_fullStr ATLAS Event Store and I/O developments in support for Production and Analysis in Run 3
title_full_unstemmed ATLAS Event Store and I/O developments in support for Production and Analysis in Run 3
title_short ATLAS Event Store and I/O developments in support for Production and Analysis in Run 3
title_sort atlas event store and i/o developments in support for production and analysis in run 3
topic Particle Physics - Experiment
url http://cds.cern.ch/record/2694039
work_keys_str_mv AT nowakmarcin atlaseventstoreandiodevelopmentsinsupportforproductionandanalysisinrun3
AT vangemmerenpeter atlaseventstoreandiodevelopmentsinsupportforproductionandanalysisinrun3
AT cranshawjack atlaseventstoreandiodevelopmentsinsupportforproductionandanalysisinrun3