Cargando…

ATLAS in-file metadata and multi-threaded processing

Processing and scientific analysis of the data taken by the ATLAS experiment requires reliable information describing the event data recorded by the detector or generated in software. ATLAS event processing applications store such descriptive metadata information in the output data files along with...

Descripción completa

Detalles Bibliográficos
Autores principales: Berghaus, Frank, Krasznahorkay, Attila, Martin, Tim, Novak, Tadej, Nowak, Marcin, Schaffer, R D, Tsulaia, Vakhtang, Van Gemmeren, Peter
Lenguaje:eng
Publicado: 2021
Materias:
Acceso en línea:https://dx.doi.org/10.1051/epjconf/202125103006
http://cds.cern.ch/record/2771455
_version_ 1780971353025806336
author Berghaus, Frank
Krasznahorkay, Attila
Martin, Tim
Novak, Tadej
Nowak, Marcin
Schaffer, R D
Tsulaia, Vakhtang
Van Gemmeren, Peter
author_facet Berghaus, Frank
Krasznahorkay, Attila
Martin, Tim
Novak, Tadej
Nowak, Marcin
Schaffer, R D
Tsulaia, Vakhtang
Van Gemmeren, Peter
author_sort Berghaus, Frank
collection CERN
description Processing and scientific analysis of the data taken by the ATLAS experiment requires reliable information describing the event data recorded by the detector or generated in software. ATLAS event processing applications store such descriptive metadata information in the output data files along with the event information. To better leverage the available computing resources during LHC Run3 the ATLAS experiment has migrated its data processing and analysis software to a multi-threaded framework: AthenaMT. Therefore in-file metadata must support concurrent event processing, especially around input file boundaries. The in-file metadata handling software was originally designed for serial event processing. It grew into a rather complex system over the many years of ATLAS operation. To migrate this system to the multi-threaded environment it was necessary to adopt several pragmatic solutions, mainly because of the shortage of available person-power to work on this project in early phases of the AthenaMT development. In order to simplify the migration, first the redundant parts of the code were cleaned up wherever possible. Next the infrastructure was improved by removing reliance on constructs that are problematic during multi-threaded processing. Finally, the remaining software infrastructure was redesigned for thread safety.
id cern-2771455
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2021
record_format invenio
spelling cern-27714552022-11-17T15:36:29Zdoi:10.1051/epjconf/202125103006http://cds.cern.ch/record/2771455engBerghaus, FrankKrasznahorkay, AttilaMartin, TimNovak, TadejNowak, MarcinSchaffer, R DTsulaia, VakhtangVan Gemmeren, PeterATLAS in-file metadata and multi-threaded processingParticle Physics - ExperimentDetectors and Experimental TechniquesComputing and ComputersProcessing and scientific analysis of the data taken by the ATLAS experiment requires reliable information describing the event data recorded by the detector or generated in software. ATLAS event processing applications store such descriptive metadata information in the output data files along with the event information. To better leverage the available computing resources during LHC Run3 the ATLAS experiment has migrated its data processing and analysis software to a multi-threaded framework: AthenaMT. Therefore in-file metadata must support concurrent event processing, especially around input file boundaries. The in-file metadata handling software was originally designed for serial event processing. It grew into a rather complex system over the many years of ATLAS operation. To migrate this system to the multi-threaded environment it was necessary to adopt several pragmatic solutions, mainly because of the shortage of available person-power to work on this project in early phases of the AthenaMT development. In order to simplify the migration, first the redundant parts of the code were cleaned up wherever possible. Next the infrastructure was improved by removing reliance on constructs that are problematic during multi-threaded processing. Finally, the remaining software infrastructure was redesigned for thread safety.Processing and scientific analysis of the data taken by the ATLAS experiment requires reliable information describing the event data recorded by the detector or generated in software. ATLAS event processing applications store such descriptive metadata information in the output data files along with the event information.To better leverage the available computing resources during LHC Run3 the ATLAS experiment has migrated its data processing and analysis software to a multi-threaded framework: AthenaMT. Therefore in-file metadata must support concurrent event processing, especially around input file boundaries. The in-file metadata handling software was originally designed for serial event processing. It grew into a rather complex system over the many years of ATLAS operation. To migrate this system to the multi-threaded environment it was necessary to adopt several pragmatic solutions, mainly because of the shortage of available person-power to work on this project in early phases of the AthenaMT development.In order to simplify the migration, first the redundant parts of the code were cleaned up wherever possible. Next the infrastructure was improved by removing reliance on constructs that are problematic during multi-threaded processing. Finally, the remaining software infrastructure was redesigned for thread safety.ATL-SOFT-PROC-2021-005oai:cds.cern.ch:27714552021-06-03
spellingShingle Particle Physics - Experiment
Detectors and Experimental Techniques
Computing and Computers
Berghaus, Frank
Krasznahorkay, Attila
Martin, Tim
Novak, Tadej
Nowak, Marcin
Schaffer, R D
Tsulaia, Vakhtang
Van Gemmeren, Peter
ATLAS in-file metadata and multi-threaded processing
title ATLAS in-file metadata and multi-threaded processing
title_full ATLAS in-file metadata and multi-threaded processing
title_fullStr ATLAS in-file metadata and multi-threaded processing
title_full_unstemmed ATLAS in-file metadata and multi-threaded processing
title_short ATLAS in-file metadata and multi-threaded processing
title_sort atlas in-file metadata and multi-threaded processing
topic Particle Physics - Experiment
Detectors and Experimental Techniques
Computing and Computers
url https://dx.doi.org/10.1051/epjconf/202125103006
http://cds.cern.ch/record/2771455
work_keys_str_mv AT berghausfrank atlasinfilemetadataandmultithreadedprocessing
AT krasznahorkayattila atlasinfilemetadataandmultithreadedprocessing
AT martintim atlasinfilemetadataandmultithreadedprocessing
AT novaktadej atlasinfilemetadataandmultithreadedprocessing
AT nowakmarcin atlasinfilemetadataandmultithreadedprocessing
AT schafferrd atlasinfilemetadataandmultithreadedprocessing
AT tsulaiavakhtang atlasinfilemetadataandmultithreadedprocessing
AT vangemmerenpeter atlasinfilemetadataandmultithreadedprocessing