Cargando…
A Persistent Back-End for the ATLAS TDAQ On-line Information Service (P-BEAST)
This paper describes P-BEAST, a highly scalable, highly available and durable system for archiving monitoring information of the trigger and data acquisition (TDAQ) system of the ATLAS experiment at CERN. Currently this consists of 20,000 applications running on 2,400 interconnected computers but it...
Autores principales: | , , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2011
|
Materias: | |
Acceso en línea: | http://cds.cern.ch/record/1402973 |
_version_ | 1780923708510044160 |
---|---|
author | Sicoe, A Lehmann Miotto, G Kolos, S Magnoni, L Soloviev, I |
author_facet | Sicoe, A Lehmann Miotto, G Kolos, S Magnoni, L Soloviev, I |
author_sort | Sicoe, A |
collection | CERN |
description | This paper describes P-BEAST, a highly scalable, highly available and durable system for archiving monitoring information of the trigger and data acquisition (TDAQ) system of the ATLAS experiment at CERN. Currently this consists of 20,000 applications running on 2,400 interconnected computers but it is foreseen to grow further in the near future. P-BEAST stores considerable amounts of monitoring information which would otherwise be lost. Making this data accessible, facilitates long term analysis and faster debugging. The novelty of this research consists of using a modern key-value storage technology (Cassandra) to satisfy the massive time series data rates, flexibility and scalability requirements entailed by the project. The loose schema allows the stored data to evolve seamlessly with the information flowing within the Information Service. An architectural overview of P-BEAST is presented alongside a discussion about the technologies considered as candidates for storing the data. The arguments which ultimately lead to choosing Cassandra are explained. Measurements taken during operation in production environment illustrate the data volume absorbed by the system and techniques for reducing the required Cassandra storage space overhead. |
id | cern-1402973 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2011 |
record_format | invenio |
spelling | cern-14029732019-09-30T06:29:59Zhttp://cds.cern.ch/record/1402973engSicoe, ALehmann Miotto, GKolos, SMagnoni, LSoloviev, IA Persistent Back-End for the ATLAS TDAQ On-line Information Service (P-BEAST)Detectors and Experimental TechniquesThis paper describes P-BEAST, a highly scalable, highly available and durable system for archiving monitoring information of the trigger and data acquisition (TDAQ) system of the ATLAS experiment at CERN. Currently this consists of 20,000 applications running on 2,400 interconnected computers but it is foreseen to grow further in the near future. P-BEAST stores considerable amounts of monitoring information which would otherwise be lost. Making this data accessible, facilitates long term analysis and faster debugging. The novelty of this research consists of using a modern key-value storage technology (Cassandra) to satisfy the massive time series data rates, flexibility and scalability requirements entailed by the project. The loose schema allows the stored data to evolve seamlessly with the information flowing within the Information Service. An architectural overview of P-BEAST is presented alongside a discussion about the technologies considered as candidates for storing the data. The arguments which ultimately lead to choosing Cassandra are explained. Measurements taken during operation in production environment illustrate the data volume absorbed by the system and techniques for reducing the required Cassandra storage space overhead.ATL-DAQ-PROC-2011-047oai:cds.cern.ch:14029732011-11-29 |
spellingShingle | Detectors and Experimental Techniques Sicoe, A Lehmann Miotto, G Kolos, S Magnoni, L Soloviev, I A Persistent Back-End for the ATLAS TDAQ On-line Information Service (P-BEAST) |
title | A Persistent Back-End for the ATLAS TDAQ On-line Information Service (P-BEAST) |
title_full | A Persistent Back-End for the ATLAS TDAQ On-line Information Service (P-BEAST) |
title_fullStr | A Persistent Back-End for the ATLAS TDAQ On-line Information Service (P-BEAST) |
title_full_unstemmed | A Persistent Back-End for the ATLAS TDAQ On-line Information Service (P-BEAST) |
title_short | A Persistent Back-End for the ATLAS TDAQ On-line Information Service (P-BEAST) |
title_sort | persistent back-end for the atlas tdaq on-line information service (p-beast) |
topic | Detectors and Experimental Techniques |
url | http://cds.cern.ch/record/1402973 |
work_keys_str_mv | AT sicoea apersistentbackendfortheatlastdaqonlineinformationservicepbeast AT lehmannmiottog apersistentbackendfortheatlastdaqonlineinformationservicepbeast AT koloss apersistentbackendfortheatlastdaqonlineinformationservicepbeast AT magnonil apersistentbackendfortheatlastdaqonlineinformationservicepbeast AT solovievi apersistentbackendfortheatlastdaqonlineinformationservicepbeast AT sicoea persistentbackendfortheatlastdaqonlineinformationservicepbeast AT lehmannmiottog persistentbackendfortheatlastdaqonlineinformationservicepbeast AT koloss persistentbackendfortheatlastdaqonlineinformationservicepbeast AT magnonil persistentbackendfortheatlastdaqonlineinformationservicepbeast AT solovievi persistentbackendfortheatlastdaqonlineinformationservicepbeast |