Cargando…
ATLAS Event Store and I/O developments in support for Production and Analysis in Run 3
During the long shutdown, ATLAS is preparing several fundamental changes to its offline event processing framework and analysis model. These include moving to multi-threaded reconstruction and simulation and reducing data duplication during derivation analysis by producing a combined mini-xAOD strea...
Autores principales: | , , |
---|---|
Lenguaje: | eng |
Publicado: |
2019
|
Materias: | |
Acceso en línea: | http://cds.cern.ch/record/2694039 |
_version_ | 1780964064518733824 |
---|---|
author | Nowak, Marcin Van Gemmeren, Peter Cranshaw, Jack |
author_facet | Nowak, Marcin Van Gemmeren, Peter Cranshaw, Jack |
author_sort | Nowak, Marcin |
collection | CERN |
description | During the long shutdown, ATLAS is preparing several fundamental changes to its offline event processing framework and analysis model. These include moving to multi-threaded reconstruction and simulation and reducing data duplication during derivation analysis by producing a combined mini-xAOD stream. These changes will allow ATLAS to take advantage of the higher luminosity at Run 3 without overstraining processing and storage capabilities. They also require significant changes to the underlying event store and the I/O framework to support them. These changes and their effects are discussed in the presentation: * The Run 2 I/O framework was overhauled to be thread-safe and minimize serial bottlenecks. * For object navigation, new immutable references are deployed, which don’t rely on storage container entry number so data can be merged in-memory. * Filter decisions can be used to annotate combined output stream allowing for fast event selection on input. * Compression algorithms and settings were optimized to allow efficient reading of event selections. |
id | cern-2694039 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2019 |
record_format | invenio |
spelling | cern-26940392019-10-18T18:44:08Zhttp://cds.cern.ch/record/2694039engNowak, MarcinVan Gemmeren, PeterCranshaw, JackATLAS Event Store and I/O developments in support for Production and Analysis in Run 3Particle Physics - ExperimentDuring the long shutdown, ATLAS is preparing several fundamental changes to its offline event processing framework and analysis model. These include moving to multi-threaded reconstruction and simulation and reducing data duplication during derivation analysis by producing a combined mini-xAOD stream. These changes will allow ATLAS to take advantage of the higher luminosity at Run 3 without overstraining processing and storage capabilities. They also require significant changes to the underlying event store and the I/O framework to support them. These changes and their effects are discussed in the presentation: * The Run 2 I/O framework was overhauled to be thread-safe and minimize serial bottlenecks. * For object navigation, new immutable references are deployed, which don’t rely on storage container entry number so data can be merged in-memory. * Filter decisions can be used to annotate combined output stream allowing for fast event selection on input. * Compression algorithms and settings were optimized to allow efficient reading of event selections.ATL-SOFT-SLIDE-2019-777oai:cds.cern.ch:26940392019-10-18 |
spellingShingle | Particle Physics - Experiment Nowak, Marcin Van Gemmeren, Peter Cranshaw, Jack ATLAS Event Store and I/O developments in support for Production and Analysis in Run 3 |
title | ATLAS Event Store and I/O developments in support for Production and Analysis in Run 3 |
title_full | ATLAS Event Store and I/O developments in support for Production and Analysis in Run 3 |
title_fullStr | ATLAS Event Store and I/O developments in support for Production and Analysis in Run 3 |
title_full_unstemmed | ATLAS Event Store and I/O developments in support for Production and Analysis in Run 3 |
title_short | ATLAS Event Store and I/O developments in support for Production and Analysis in Run 3 |
title_sort | atlas event store and i/o developments in support for production and analysis in run 3 |
topic | Particle Physics - Experiment |
url | http://cds.cern.ch/record/2694039 |
work_keys_str_mv | AT nowakmarcin atlaseventstoreandiodevelopmentsinsupportforproductionandanalysisinrun3 AT vangemmerenpeter atlaseventstoreandiodevelopmentsinsupportforproductionandanalysisinrun3 AT cranshawjack atlaseventstoreandiodevelopmentsinsupportforproductionandanalysisinrun3 |