Cargando…

A Persistent Back-End for the ATLAS TDAQ On-line Information Service (P-BEAST)

This paper describes P-BEAST, a highly scalable, highly available and durable system for archiving monitoring information of the trigger and data acquisition (TDAQ) system of the ATLAS experiment at CERN. Currently this consists of 20,000 applications running on 2,400 interconnected computers but it...

Descripción completa

Detalles Bibliográficos
Autores principales: Sicoe, A, Lehmann Miotto, G, Kolos, S, Magnoni, L, Soloviev, I
Lenguaje:eng
Publicado: 2011
Materias:
Acceso en línea:http://cds.cern.ch/record/1402973
_version_ 1780923708510044160
author Sicoe, A
Lehmann Miotto, G
Kolos, S
Magnoni, L
Soloviev, I
author_facet Sicoe, A
Lehmann Miotto, G
Kolos, S
Magnoni, L
Soloviev, I
author_sort Sicoe, A
collection CERN
description This paper describes P-BEAST, a highly scalable, highly available and durable system for archiving monitoring information of the trigger and data acquisition (TDAQ) system of the ATLAS experiment at CERN. Currently this consists of 20,000 applications running on 2,400 interconnected computers but it is foreseen to grow further in the near future. P-BEAST stores considerable amounts of monitoring information which would otherwise be lost. Making this data accessible, facilitates long term analysis and faster debugging. The novelty of this research consists of using a modern key-value storage technology (Cassandra) to satisfy the massive time series data rates, flexibility and scalability requirements entailed by the project. The loose schema allows the stored data to evolve seamlessly with the information flowing within the Information Service. An architectural overview of P-BEAST is presented alongside a discussion about the technologies considered as candidates for storing the data. The arguments which ultimately lead to choosing Cassandra are explained. Measurements taken during operation in production environment illustrate the data volume absorbed by the system and techniques for reducing the required Cassandra storage space overhead.
id cern-1402973
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2011
record_format invenio
spelling cern-14029732019-09-30T06:29:59Zhttp://cds.cern.ch/record/1402973engSicoe, ALehmann Miotto, GKolos, SMagnoni, LSoloviev, IA Persistent Back-End for the ATLAS TDAQ On-line Information Service (P-BEAST)Detectors and Experimental TechniquesThis paper describes P-BEAST, a highly scalable, highly available and durable system for archiving monitoring information of the trigger and data acquisition (TDAQ) system of the ATLAS experiment at CERN. Currently this consists of 20,000 applications running on 2,400 interconnected computers but it is foreseen to grow further in the near future. P-BEAST stores considerable amounts of monitoring information which would otherwise be lost. Making this data accessible, facilitates long term analysis and faster debugging. The novelty of this research consists of using a modern key-value storage technology (Cassandra) to satisfy the massive time series data rates, flexibility and scalability requirements entailed by the project. The loose schema allows the stored data to evolve seamlessly with the information flowing within the Information Service. An architectural overview of P-BEAST is presented alongside a discussion about the technologies considered as candidates for storing the data. The arguments which ultimately lead to choosing Cassandra are explained. Measurements taken during operation in production environment illustrate the data volume absorbed by the system and techniques for reducing the required Cassandra storage space overhead.ATL-DAQ-PROC-2011-047oai:cds.cern.ch:14029732011-11-29
spellingShingle Detectors and Experimental Techniques
Sicoe, A
Lehmann Miotto, G
Kolos, S
Magnoni, L
Soloviev, I
A Persistent Back-End for the ATLAS TDAQ On-line Information Service (P-BEAST)
title A Persistent Back-End for the ATLAS TDAQ On-line Information Service (P-BEAST)
title_full A Persistent Back-End for the ATLAS TDAQ On-line Information Service (P-BEAST)
title_fullStr A Persistent Back-End for the ATLAS TDAQ On-line Information Service (P-BEAST)
title_full_unstemmed A Persistent Back-End for the ATLAS TDAQ On-line Information Service (P-BEAST)
title_short A Persistent Back-End for the ATLAS TDAQ On-line Information Service (P-BEAST)
title_sort persistent back-end for the atlas tdaq on-line information service (p-beast)
topic Detectors and Experimental Techniques
url http://cds.cern.ch/record/1402973
work_keys_str_mv AT sicoea apersistentbackendfortheatlastdaqonlineinformationservicepbeast
AT lehmannmiottog apersistentbackendfortheatlastdaqonlineinformationservicepbeast
AT koloss apersistentbackendfortheatlastdaqonlineinformationservicepbeast
AT magnonil apersistentbackendfortheatlastdaqonlineinformationservicepbeast
AT solovievi apersistentbackendfortheatlastdaqonlineinformationservicepbeast
AT sicoea persistentbackendfortheatlastdaqonlineinformationservicepbeast
AT lehmannmiottog persistentbackendfortheatlastdaqonlineinformationservicepbeast
AT koloss persistentbackendfortheatlastdaqonlineinformationservicepbeast
AT magnonil persistentbackendfortheatlastdaqonlineinformationservicepbeast
AT solovievi persistentbackendfortheatlastdaqonlineinformationservicepbeast