Cargando…

Buffer Provisioning for Large-Scale Data-Acquisition Systems

The data acquisition system of the ATLAS experiment, a major experiment of the Large Hadron Collider (LHC) at CERN, will go through a major upgrade in the next decade. The upgrade is driven by experimental physics requirements, calling for increased data rates on the order of 6~TB/s. By contrast, th...

Descripción completa

Detalles Bibliográficos
Autores principales: Santos, Alejandro, Vandelli, Wainer, Froening, Holger, Garcia Garcia, Pedro Javier
Lenguaje:eng
Publicado: 2018
Materias:
Acceso en línea:http://cds.cern.ch/record/2630339
_version_ 1780959409345658880
author Santos, Alejandro
Vandelli, Wainer
Froening, Holger
Garcia Garcia, Pedro Javier
author_facet Santos, Alejandro
Vandelli, Wainer
Froening, Holger
Garcia Garcia, Pedro Javier
author_sort Santos, Alejandro
collection CERN
description The data acquisition system of the ATLAS experiment, a major experiment of the Large Hadron Collider (LHC) at CERN, will go through a major upgrade in the next decade. The upgrade is driven by experimental physics requirements, calling for increased data rates on the order of 6~TB/s. By contrast, the data rate of the existing system is 160~GB/s. Among the changes in the upgraded system will be a very large buffer with a projected size on the order of 70 PB. The buffer role will be decoupling of data production from on-line data processing, storing data for periods of up to 24~hours until it can be analyzed by the event processing system. The larger buffer will allow a new data recording strategy, providing additional margins to handle variable data rates. At the same time it will provide sensible trade-offs between buffering space and on-line processing capabilities. This compromise between two resources will be possible since the data production cycle includes time periods where the experiment will not produce data. In this paper we analyze the consequences of such trade-offs, and introduce a tool that allows a detailed exploration of different strategies for resource provisioning. It is based on a model of the upgraded data acquisition system, implemented in a simulation framework. From this model it is possible to obtain insight into the dynamics of the running system. Given predefined resource constraints, we provide bounds for the provisioning of buffering space and on-line processing requirements.
id cern-2630339
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2018
record_format invenio
spelling cern-26303392019-09-30T06:29:59Zhttp://cds.cern.ch/record/2630339engSantos, AlejandroVandelli, WainerFroening, HolgerGarcia Garcia, Pedro JavierBuffer Provisioning for Large-Scale Data-Acquisition SystemsParticle Physics - ExperimentThe data acquisition system of the ATLAS experiment, a major experiment of the Large Hadron Collider (LHC) at CERN, will go through a major upgrade in the next decade. The upgrade is driven by experimental physics requirements, calling for increased data rates on the order of 6~TB/s. By contrast, the data rate of the existing system is 160~GB/s. Among the changes in the upgraded system will be a very large buffer with a projected size on the order of 70 PB. The buffer role will be decoupling of data production from on-line data processing, storing data for periods of up to 24~hours until it can be analyzed by the event processing system. The larger buffer will allow a new data recording strategy, providing additional margins to handle variable data rates. At the same time it will provide sensible trade-offs between buffering space and on-line processing capabilities. This compromise between two resources will be possible since the data production cycle includes time periods where the experiment will not produce data. In this paper we analyze the consequences of such trade-offs, and introduce a tool that allows a detailed exploration of different strategies for resource provisioning. It is based on a model of the upgraded data acquisition system, implemented in a simulation framework. From this model it is possible to obtain insight into the dynamics of the running system. Given predefined resource constraints, we provide bounds for the provisioning of buffering space and on-line processing requirements.ATL-DAQ-SLIDE-2018-481oai:cds.cern.ch:26303392018-07-11
spellingShingle Particle Physics - Experiment
Santos, Alejandro
Vandelli, Wainer
Froening, Holger
Garcia Garcia, Pedro Javier
Buffer Provisioning for Large-Scale Data-Acquisition Systems
title Buffer Provisioning for Large-Scale Data-Acquisition Systems
title_full Buffer Provisioning for Large-Scale Data-Acquisition Systems
title_fullStr Buffer Provisioning for Large-Scale Data-Acquisition Systems
title_full_unstemmed Buffer Provisioning for Large-Scale Data-Acquisition Systems
title_short Buffer Provisioning for Large-Scale Data-Acquisition Systems
title_sort buffer provisioning for large-scale data-acquisition systems
topic Particle Physics - Experiment
url http://cds.cern.ch/record/2630339
work_keys_str_mv AT santosalejandro bufferprovisioningforlargescaledataacquisitionsystems
AT vandelliwainer bufferprovisioningforlargescaledataacquisitionsystems
AT froeningholger bufferprovisioningforlargescaledataacquisitionsystems
AT garciagarciapedrojavier bufferprovisioningforlargescaledataacquisitionsystems