Cargando…
I/O in the ATLAS multithreaded framework
Scalable multithreading poses challenges to I/O for the ATLAS experiment. The performance of a thread-safe I/O strategy may depend upon many factors, including I/O latencies, whether tasks are CPU- or I/O-intensive, and thread count. In a multithreaded framework, an I/O infrastructure must efficient...
Autores principales: | , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2018
|
Materias: | |
Acceso en línea: | http://cds.cern.ch/record/2648823 |
_version_ | 1780960698653736960 |
---|---|
author | Cranshaw, Jack Van Gemmeren, Peter Nowak, Marcin Malon, David |
author_facet | Cranshaw, Jack Van Gemmeren, Peter Nowak, Marcin Malon, David |
author_sort | Cranshaw, Jack |
collection | CERN |
description | Scalable multithreading poses challenges to I/O for the ATLAS experiment. The performance of a thread-safe I/O strategy may depend upon many factors, including I/O latencies, whether tasks are CPU- or I/O-intensive, and thread count. In a multithreaded framework, an I/O infrastructure must efficiently supply event data to and collect it from many threads processing multiple events in flight. In particular, on-demand reading from multiple threads may challenge caching strategies that were developed for serial processing and may need to be enhanced. This I/O infrastructure must also address how to read, make available, and propagate in-file metadata and other non-event data needed as context for event processing. We describe the design and scheduling of I/O components in the ATLAS multithreaded control framework, AthenaMT, for both event and non-event I/O. We discuss issues associated with exploiting the multithreading capabilities of our underlying persistence technology, ROOT, in a manner harmonious with the ATLAS framework's own approach to thread management. Finally, we discuss opportunities for evolution and simplification of I/O components that have successfully supported ATLAS event processing for many years from their serial incarnations to their thread-safe counterparts. |
id | cern-2648823 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2018 |
record_format | invenio |
spelling | cern-26488232019-09-30T06:29:59Zhttp://cds.cern.ch/record/2648823engCranshaw, JackVan Gemmeren, PeterNowak, MarcinMalon, DavidI/O in the ATLAS multithreaded frameworkParticle Physics - ExperimentScalable multithreading poses challenges to I/O for the ATLAS experiment. The performance of a thread-safe I/O strategy may depend upon many factors, including I/O latencies, whether tasks are CPU- or I/O-intensive, and thread count. In a multithreaded framework, an I/O infrastructure must efficiently supply event data to and collect it from many threads processing multiple events in flight. In particular, on-demand reading from multiple threads may challenge caching strategies that were developed for serial processing and may need to be enhanced. This I/O infrastructure must also address how to read, make available, and propagate in-file metadata and other non-event data needed as context for event processing. We describe the design and scheduling of I/O components in the ATLAS multithreaded control framework, AthenaMT, for both event and non-event I/O. We discuss issues associated with exploiting the multithreading capabilities of our underlying persistence technology, ROOT, in a manner harmonious with the ATLAS framework's own approach to thread management. Finally, we discuss opportunities for evolution and simplification of I/O components that have successfully supported ATLAS event processing for many years from their serial incarnations to their thread-safe counterparts.ATL-SOFT-PROC-2018-027oai:cds.cern.ch:26488232018-11-24 |
spellingShingle | Particle Physics - Experiment Cranshaw, Jack Van Gemmeren, Peter Nowak, Marcin Malon, David I/O in the ATLAS multithreaded framework |
title | I/O in the ATLAS multithreaded framework |
title_full | I/O in the ATLAS multithreaded framework |
title_fullStr | I/O in the ATLAS multithreaded framework |
title_full_unstemmed | I/O in the ATLAS multithreaded framework |
title_short | I/O in the ATLAS multithreaded framework |
title_sort | i/o in the atlas multithreaded framework |
topic | Particle Physics - Experiment |
url | http://cds.cern.ch/record/2648823 |
work_keys_str_mv | AT cranshawjack iointheatlasmultithreadedframework AT vangemmerenpeter iointheatlasmultithreadedframework AT nowakmarcin iointheatlasmultithreadedframework AT malondavid iointheatlasmultithreadedframework |