Cargando…

I/O in the ATLAS multithreaded framework

Scalable multithreading poses challenges to I/O for the ATLAS experiment. The performance of a thread-safe I/O strategy may depend upon many factors, including I/O latencies, whether tasks are CPU- or I/O-intensive, and thread count. In a multithreaded framework, an I/O infrastructure must efficient...

Descripción completa

Detalles Bibliográficos
Autores principales: Cranshaw, Jack, Van Gemmeren, Peter, Nowak, Marcin, Malon, David
Lenguaje:eng
Publicado: 2018
Materias:
Acceso en línea:http://cds.cern.ch/record/2648823
_version_ 1780960698653736960
author Cranshaw, Jack
Van Gemmeren, Peter
Nowak, Marcin
Malon, David
author_facet Cranshaw, Jack
Van Gemmeren, Peter
Nowak, Marcin
Malon, David
author_sort Cranshaw, Jack
collection CERN
description Scalable multithreading poses challenges to I/O for the ATLAS experiment. The performance of a thread-safe I/O strategy may depend upon many factors, including I/O latencies, whether tasks are CPU- or I/O-intensive, and thread count. In a multithreaded framework, an I/O infrastructure must efficiently supply event data to and collect it from many threads processing multiple events in flight. In particular, on-demand reading from multiple threads may challenge caching strategies that were developed for serial processing and may need to be enhanced. This I/O infrastructure must also address how to read, make available, and propagate in-file metadata and other non-event data needed as context for event processing. We describe the design and scheduling of I/O components in the ATLAS multithreaded control framework, AthenaMT, for both event and non-event I/O. We discuss issues associated with exploiting the multithreading capabilities of our underlying persistence technology, ROOT, in a manner harmonious with the ATLAS framework's own approach to thread management. Finally, we discuss opportunities for evolution and simplification of I/O components that have successfully supported ATLAS event processing for many years from their serial incarnations to their thread-safe counterparts.
id cern-2648823
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2018
record_format invenio
spelling cern-26488232019-09-30T06:29:59Zhttp://cds.cern.ch/record/2648823engCranshaw, JackVan Gemmeren, PeterNowak, MarcinMalon, DavidI/O in the ATLAS multithreaded frameworkParticle Physics - ExperimentScalable multithreading poses challenges to I/O for the ATLAS experiment. The performance of a thread-safe I/O strategy may depend upon many factors, including I/O latencies, whether tasks are CPU- or I/O-intensive, and thread count. In a multithreaded framework, an I/O infrastructure must efficiently supply event data to and collect it from many threads processing multiple events in flight. In particular, on-demand reading from multiple threads may challenge caching strategies that were developed for serial processing and may need to be enhanced. This I/O infrastructure must also address how to read, make available, and propagate in-file metadata and other non-event data needed as context for event processing. We describe the design and scheduling of I/O components in the ATLAS multithreaded control framework, AthenaMT, for both event and non-event I/O. We discuss issues associated with exploiting the multithreading capabilities of our underlying persistence technology, ROOT, in a manner harmonious with the ATLAS framework's own approach to thread management. Finally, we discuss opportunities for evolution and simplification of I/O components that have successfully supported ATLAS event processing for many years from their serial incarnations to their thread-safe counterparts.ATL-SOFT-PROC-2018-027oai:cds.cern.ch:26488232018-11-24
spellingShingle Particle Physics - Experiment
Cranshaw, Jack
Van Gemmeren, Peter
Nowak, Marcin
Malon, David
I/O in the ATLAS multithreaded framework
title I/O in the ATLAS multithreaded framework
title_full I/O in the ATLAS multithreaded framework
title_fullStr I/O in the ATLAS multithreaded framework
title_full_unstemmed I/O in the ATLAS multithreaded framework
title_short I/O in the ATLAS multithreaded framework
title_sort i/o in the atlas multithreaded framework
topic Particle Physics - Experiment
url http://cds.cern.ch/record/2648823
work_keys_str_mv AT cranshawjack iointheatlasmultithreadedframework
AT vangemmerenpeter iointheatlasmultithreadedframework
AT nowakmarcin iointheatlasmultithreadedframework
AT malondavid iointheatlasmultithreadedframework