Cargando…
ATLAS in-file metadata and multi-threaded processing
<!--HTML-->Processing and scientific analysis of the data taken by the ATLAS experiment requires reliable information describing the event data recorded by the detector or generated in software. ATLAS event processing applications store such descriptive metadata information in the output data...
Autor principal: | |
---|---|
Lenguaje: | eng |
Publicado: |
2021
|
Materias: | |
Acceso en línea: | http://cds.cern.ch/record/2767127 |
_version_ | 1780971272412332032 |
---|---|
author | Berghaus, Frank |
author_facet | Berghaus, Frank |
author_sort | Berghaus, Frank |
collection | CERN |
description | <!--HTML-->Processing and scientific analysis of the data taken by the ATLAS experiment requires reliable information describing the event data recorded by the detector or generated in software. ATLAS event processing applications store such descriptive metadata information in the output data files along with the event information.
To better leverage the available computing resources during LHC Run3 the ATLAS experiment has migrated its data processing and analysis software to a multi-threaded framework: AthenaMT. Therefore in-file metadata must support concurrent event processing, especially around input file boundaries. The in-file metadata handling software was originally designed for serial event processing. It grew into a rather complex system over the many years of ATLAS operation. To migrate this system to the multi-threaded environment it was necessary to adopt several pragmatic solutions, mainly because of the shortage of available person-power to work on this project in early phases of the AthenaMT development.
In order to simplify the migration, first the redundant parts of the code were cleaned up wherever possible. Next the infrastructure was improved by removing reliance on constructs that are problematic during multi-threaded processing. Finally, the remaining software infrastructure was redesigned for thread safety. |
id | cern-2767127 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2021 |
record_format | invenio |
spelling | cern-27671272022-11-02T22:25:40Zhttp://cds.cern.ch/record/2767127engBerghaus, FrankATLAS in-file metadata and multi-threaded processing25th International Conference on Computing in High Energy & Nuclear PhysicsConferences<!--HTML-->Processing and scientific analysis of the data taken by the ATLAS experiment requires reliable information describing the event data recorded by the detector or generated in software. ATLAS event processing applications store such descriptive metadata information in the output data files along with the event information. To better leverage the available computing resources during LHC Run3 the ATLAS experiment has migrated its data processing and analysis software to a multi-threaded framework: AthenaMT. Therefore in-file metadata must support concurrent event processing, especially around input file boundaries. The in-file metadata handling software was originally designed for serial event processing. It grew into a rather complex system over the many years of ATLAS operation. To migrate this system to the multi-threaded environment it was necessary to adopt several pragmatic solutions, mainly because of the shortage of available person-power to work on this project in early phases of the AthenaMT development. In order to simplify the migration, first the redundant parts of the code were cleaned up wherever possible. Next the infrastructure was improved by removing reliance on constructs that are problematic during multi-threaded processing. Finally, the remaining software infrastructure was redesigned for thread safety.oai:cds.cern.ch:27671272021 |
spellingShingle | Conferences Berghaus, Frank ATLAS in-file metadata and multi-threaded processing |
title | ATLAS in-file metadata and multi-threaded processing |
title_full | ATLAS in-file metadata and multi-threaded processing |
title_fullStr | ATLAS in-file metadata and multi-threaded processing |
title_full_unstemmed | ATLAS in-file metadata and multi-threaded processing |
title_short | ATLAS in-file metadata and multi-threaded processing |
title_sort | atlas in-file metadata and multi-threaded processing |
topic | Conferences |
url | http://cds.cern.ch/record/2767127 |
work_keys_str_mv | AT berghausfrank atlasinfilemetadataandmultithreadedprocessing AT berghausfrank 25thinternationalconferenceoncomputinginhighenergynuclearphysics |