Cargando…
R&D Studies on a Persistent Storage Buffer for the ATLAS Phase-II DAQ System
The ATLAS experiment will undergo a major upgrade to adapt to the HL-LHC. The Trigger and Data Acquisition system (TDAQ) will record data at unprecedented rates: detectors will be read out at 1 MHz generating around 5 TB/s of data. Within TDAQ the Dataflow system (DF) introduces a novel design: read...
Autores principales: | , , |
---|---|
Lenguaje: | eng |
Publicado: |
2021
|
Materias: | |
Acceso en línea: | http://cds.cern.ch/record/2772459 |
_version_ | 1780971444997455872 |
---|---|
author | Abed Abud, Adam Bonaventura, Matias Alejandro Le Goff, Fabrice |
author_facet | Abed Abud, Adam Bonaventura, Matias Alejandro Le Goff, Fabrice |
author_sort | Abed Abud, Adam |
collection | CERN |
description | The ATLAS experiment will undergo a major upgrade to adapt to the HL-LHC. The Trigger and Data Acquisition system (TDAQ) will record data at unprecedented rates: detectors will be read out at 1 MHz generating around 5 TB/s of data. Within TDAQ the Dataflow system (DF) introduces a novel design: readout data are buffered on persistent storage while the event filtering system selects 10 kHz of events for a total throughput of around 60 GB/s. New challenges arise for DF to design and implement a distributed, reliable, persistent storage system supporting several TB/s of aggregated throughput while providing tens of PB of capacity. In this paper after describing some of these challenges, we present the ongoing R&D to address each of them: data safety, indexing at high rates in a distributed system, and high-performance management of storage capacity. Finally, the performance achieved with a working prototype is shown. |
id | cern-2772459 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2021 |
record_format | invenio |
spelling | cern-27724592023-06-07T13:12:00Zhttp://cds.cern.ch/record/2772459engAbed Abud, AdamBonaventura, Matias AlejandroLe Goff, FabriceR&D Studies on a Persistent Storage Buffer for the ATLAS Phase-II DAQ SystemParticle Physics - ExperimentThe ATLAS experiment will undergo a major upgrade to adapt to the HL-LHC. The Trigger and Data Acquisition system (TDAQ) will record data at unprecedented rates: detectors will be read out at 1 MHz generating around 5 TB/s of data. Within TDAQ the Dataflow system (DF) introduces a novel design: readout data are buffered on persistent storage while the event filtering system selects 10 kHz of events for a total throughput of around 60 GB/s. New challenges arise for DF to design and implement a distributed, reliable, persistent storage system supporting several TB/s of aggregated throughput while providing tens of PB of capacity. In this paper after describing some of these challenges, we present the ongoing R&D to address each of them: data safety, indexing at high rates in a distributed system, and high-performance management of storage capacity. Finally, the performance achieved with a working prototype is shown.ATL-DAQ-SLIDE-2021-223oai:cds.cern.ch:27724592021-06-11 |
spellingShingle | Particle Physics - Experiment Abed Abud, Adam Bonaventura, Matias Alejandro Le Goff, Fabrice R&D Studies on a Persistent Storage Buffer for the ATLAS Phase-II DAQ System |
title | R&D Studies on a Persistent Storage Buffer for the ATLAS Phase-II DAQ System |
title_full | R&D Studies on a Persistent Storage Buffer for the ATLAS Phase-II DAQ System |
title_fullStr | R&D Studies on a Persistent Storage Buffer for the ATLAS Phase-II DAQ System |
title_full_unstemmed | R&D Studies on a Persistent Storage Buffer for the ATLAS Phase-II DAQ System |
title_short | R&D Studies on a Persistent Storage Buffer for the ATLAS Phase-II DAQ System |
title_sort | r&d studies on a persistent storage buffer for the atlas phase-ii daq system |
topic | Particle Physics - Experiment |
url | http://cds.cern.ch/record/2772459 |
work_keys_str_mv | AT abedabudadam rdstudiesonapersistentstoragebufferfortheatlasphaseiidaqsystem AT bonaventuramatiasalejandro rdstudiesonapersistentstoragebufferfortheatlasphaseiidaqsystem AT legofffabrice rdstudiesonapersistentstoragebufferfortheatlasphaseiidaqsystem |