Cargando…

R&D Studies on a Persistent Storage Buffer for the ATLAS Phase-II DAQ System

The ATLAS experiment will undergo a major upgrade to adapt to the HL-LHC. The Trigger and Data Acquisition system (TDAQ) will record data at unprecedented rates: detectors will be read out at 1 MHz generating around 5 TB/s of data. Within TDAQ the Dataflow system (DF) introduces a novel design: read...

Descripción completa

Detalles Bibliográficos
Autores principales: Abed Abud, Adam, Bonaventura, Matias Alejandro, Le Goff, Fabrice
Lenguaje:eng
Publicado: 2021
Materias:
Acceso en línea:http://cds.cern.ch/record/2772459
_version_ 1780971444997455872
author Abed Abud, Adam
Bonaventura, Matias Alejandro
Le Goff, Fabrice
author_facet Abed Abud, Adam
Bonaventura, Matias Alejandro
Le Goff, Fabrice
author_sort Abed Abud, Adam
collection CERN
description The ATLAS experiment will undergo a major upgrade to adapt to the HL-LHC. The Trigger and Data Acquisition system (TDAQ) will record data at unprecedented rates: detectors will be read out at 1 MHz generating around 5 TB/s of data. Within TDAQ the Dataflow system (DF) introduces a novel design: readout data are buffered on persistent storage while the event filtering system selects 10 kHz of events for a total throughput of around 60 GB/s. New challenges arise for DF to design and implement a distributed, reliable, persistent storage system supporting several TB/s of aggregated throughput while providing tens of PB of capacity. In this paper after describing some of these challenges, we present the ongoing R&D to address each of them: data safety, indexing at high rates in a distributed system, and high-performance management of storage capacity. Finally, the performance achieved with a working prototype is shown.
id cern-2772459
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2021
record_format invenio
spelling cern-27724592023-06-07T13:12:00Zhttp://cds.cern.ch/record/2772459engAbed Abud, AdamBonaventura, Matias AlejandroLe Goff, FabriceR&D Studies on a Persistent Storage Buffer for the ATLAS Phase-II DAQ SystemParticle Physics - ExperimentThe ATLAS experiment will undergo a major upgrade to adapt to the HL-LHC. The Trigger and Data Acquisition system (TDAQ) will record data at unprecedented rates: detectors will be read out at 1 MHz generating around 5 TB/s of data. Within TDAQ the Dataflow system (DF) introduces a novel design: readout data are buffered on persistent storage while the event filtering system selects 10 kHz of events for a total throughput of around 60 GB/s. New challenges arise for DF to design and implement a distributed, reliable, persistent storage system supporting several TB/s of aggregated throughput while providing tens of PB of capacity. In this paper after describing some of these challenges, we present the ongoing R&D to address each of them: data safety, indexing at high rates in a distributed system, and high-performance management of storage capacity. Finally, the performance achieved with a working prototype is shown.ATL-DAQ-SLIDE-2021-223oai:cds.cern.ch:27724592021-06-11
spellingShingle Particle Physics - Experiment
Abed Abud, Adam
Bonaventura, Matias Alejandro
Le Goff, Fabrice
R&D Studies on a Persistent Storage Buffer for the ATLAS Phase-II DAQ System
title R&D Studies on a Persistent Storage Buffer for the ATLAS Phase-II DAQ System
title_full R&D Studies on a Persistent Storage Buffer for the ATLAS Phase-II DAQ System
title_fullStr R&D Studies on a Persistent Storage Buffer for the ATLAS Phase-II DAQ System
title_full_unstemmed R&D Studies on a Persistent Storage Buffer for the ATLAS Phase-II DAQ System
title_short R&D Studies on a Persistent Storage Buffer for the ATLAS Phase-II DAQ System
title_sort r&d studies on a persistent storage buffer for the atlas phase-ii daq system
topic Particle Physics - Experiment
url http://cds.cern.ch/record/2772459
work_keys_str_mv AT abedabudadam rdstudiesonapersistentstoragebufferfortheatlasphaseiidaqsystem
AT bonaventuramatiasalejandro rdstudiesonapersistentstoragebufferfortheatlasphaseiidaqsystem
AT legofffabrice rdstudiesonapersistentstoragebufferfortheatlasphaseiidaqsystem