Cargando…
ATLAS Event Store and I/O developments in support for Production and Analysis in Run 3
During the long LHC shutdown, ATLAS experiment is preparing several fundamental changes to its offline event processing framework and analysis model. These include moving to multi-threaded reconstruction and simulation and reducing data duplication during derivation analysis by producing a combined...
Autores principales: | , , |
---|---|
Lenguaje: | eng |
Publicado: |
2020
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1051/epjconf/202024502031 http://cds.cern.ch/record/2710099 |
_version_ | 1780965099122458624 |
---|---|
author | Nowak, Marcin Van Gemmeren, Peter Cranshaw, Jack |
author_facet | Nowak, Marcin Van Gemmeren, Peter Cranshaw, Jack |
author_sort | Nowak, Marcin |
collection | CERN |
description | During the long LHC shutdown, ATLAS experiment is preparing several fundamental changes to its offline event processing framework and analysis model. These include moving to multi-threaded reconstruction and simulation and reducing data duplication during derivation analysis by producing a combined mini-xAOD stream. These changes will allow ATLAS to take advantage of the higher luminosity at Run 3 without overstraining processing and storage capabilities. They also require significant improvements to the underlying event store and the I/O framework to support them. These improvements include: 1) an overhaul of the Run 2 I/O framework to be thread-safe and minimize serial bottlenecks, 2) introduction of new immutable references for object navigation, which don’t rely on storage container entry number so data can be merged in-memory, 3) using filter decisions to annotate combined output stream to allow for fast event selection on input and 4) selecting optimized compression algorithms and settings to allow efficient reading of event selections |
id | cern-2710099 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2020 |
record_format | invenio |
spelling | cern-27100992021-03-08T20:51:51Zdoi:10.1051/epjconf/202024502031http://cds.cern.ch/record/2710099engNowak, MarcinVan Gemmeren, PeterCranshaw, JackATLAS Event Store and I/O developments in support for Production and Analysis in Run 3Particle Physics - ExperimentDuring the long LHC shutdown, ATLAS experiment is preparing several fundamental changes to its offline event processing framework and analysis model. These include moving to multi-threaded reconstruction and simulation and reducing data duplication during derivation analysis by producing a combined mini-xAOD stream. These changes will allow ATLAS to take advantage of the higher luminosity at Run 3 without overstraining processing and storage capabilities. They also require significant improvements to the underlying event store and the I/O framework to support them. These improvements include: 1) an overhaul of the Run 2 I/O framework to be thread-safe and minimize serial bottlenecks, 2) introduction of new immutable references for object navigation, which don’t rely on storage container entry number so data can be merged in-memory, 3) using filter decisions to annotate combined output stream to allow for fast event selection on input and 4) selecting optimized compression algorithms and settings to allow efficient reading of event selectionsATL-SOFT-PROC-2020-015oai:cds.cern.ch:27100992020-02-18 |
spellingShingle | Particle Physics - Experiment Nowak, Marcin Van Gemmeren, Peter Cranshaw, Jack ATLAS Event Store and I/O developments in support for Production and Analysis in Run 3 |
title | ATLAS Event Store and I/O developments in support for Production and Analysis in Run 3 |
title_full | ATLAS Event Store and I/O developments in support for Production and Analysis in Run 3 |
title_fullStr | ATLAS Event Store and I/O developments in support for Production and Analysis in Run 3 |
title_full_unstemmed | ATLAS Event Store and I/O developments in support for Production and Analysis in Run 3 |
title_short | ATLAS Event Store and I/O developments in support for Production and Analysis in Run 3 |
title_sort | atlas event store and i/o developments in support for production and analysis in run 3 |
topic | Particle Physics - Experiment |
url | https://dx.doi.org/10.1051/epjconf/202024502031 http://cds.cern.ch/record/2710099 |
work_keys_str_mv | AT nowakmarcin atlaseventstoreandiodevelopmentsinsupportforproductionandanalysisinrun3 AT vangemmerenpeter atlaseventstoreandiodevelopmentsinsupportforproductionandanalysisinrun3 AT cranshawjack atlaseventstoreandiodevelopmentsinsupportforproductionandanalysisinrun3 |