Cargando…
A Validation System for the Complex Event Processing Directives of the ATLAS Shifter Assistant Tool
Complex Event Processing (CEP) is a methodology that combines data from different sources in order to identify events or patterns that need particular attention. It has gained a lot of momentum in the computing world in the past few years and is used in ATLAS to continuously monitor the behaviour of...
Autores principales: | , , , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2015
|
Materias: | |
Acceso en línea: | http://cds.cern.ch/record/2005098 |
_version_ | 1780946135837310976 |
---|---|
author | Anders, Gabriel Avolio, Giuseppe Kazarov, Andrei Lehmann Miotto, Giovanna Santos, Alejandro Soloviev, Igor |
author_facet | Anders, Gabriel Avolio, Giuseppe Kazarov, Andrei Lehmann Miotto, Giovanna Santos, Alejandro Soloviev, Igor |
author_sort | Anders, Gabriel |
collection | CERN |
description | Complex Event Processing (CEP) is a methodology that combines data from different sources in order to identify events or patterns that need particular attention. It has gained a lot of momentum in the computing world in the past few years and is used in ATLAS to continuously monitor the behaviour of the data acquisition system, to trigger corrective actions and to guide the experiment’s operators. This technology is very powerful, if experts regularly insert and update their knowledge about the system’s behaviour into the CEP engine. Nevertheless, writing or modifying CEP directives is not trivial since the used programming paradigm is quite different with respect to what developers are normally familiar with. In order to help experts verify that the directives work as expected, we have thus developed a complete testing and validation environment. This system consists of three main parts: the first is the persistent storage of all relevant data streams that are produced during data taking, the second is a playback tool that allows to re-inject data of specific data taking sessions from the past into the CEP engine and the third is a reporting tool that shows the output that the directives loaded into the engine would have produced in the live system. In this paper we describe the design, implementation and performance of this validation system, highlight its strengths and short-comings and indicate how such a system could be re-used in similar projects. |
id | cern-2005098 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2015 |
record_format | invenio |
spelling | cern-20050982019-09-30T06:29:59Zhttp://cds.cern.ch/record/2005098engAnders, GabrielAvolio, GiuseppeKazarov, AndreiLehmann Miotto, GiovannaSantos, AlejandroSoloviev, IgorA Validation System for the Complex Event Processing Directives of the ATLAS Shifter Assistant ToolParticle Physics - ExperimentComplex Event Processing (CEP) is a methodology that combines data from different sources in order to identify events or patterns that need particular attention. It has gained a lot of momentum in the computing world in the past few years and is used in ATLAS to continuously monitor the behaviour of the data acquisition system, to trigger corrective actions and to guide the experiment’s operators. This technology is very powerful, if experts regularly insert and update their knowledge about the system’s behaviour into the CEP engine. Nevertheless, writing or modifying CEP directives is not trivial since the used programming paradigm is quite different with respect to what developers are normally familiar with. In order to help experts verify that the directives work as expected, we have thus developed a complete testing and validation environment. This system consists of three main parts: the first is the persistent storage of all relevant data streams that are produced during data taking, the second is a playback tool that allows to re-inject data of specific data taking sessions from the past into the CEP engine and the third is a reporting tool that shows the output that the directives loaded into the engine would have produced in the live system. In this paper we describe the design, implementation and performance of this validation system, highlight its strengths and short-comings and indicate how such a system could be re-used in similar projects.ATL-DAQ-SLIDE-2015-121oai:cds.cern.ch:20050982015-03-30 |
spellingShingle | Particle Physics - Experiment Anders, Gabriel Avolio, Giuseppe Kazarov, Andrei Lehmann Miotto, Giovanna Santos, Alejandro Soloviev, Igor A Validation System for the Complex Event Processing Directives of the ATLAS Shifter Assistant Tool |
title | A Validation System for the Complex Event Processing Directives of the ATLAS Shifter Assistant Tool |
title_full | A Validation System for the Complex Event Processing Directives of the ATLAS Shifter Assistant Tool |
title_fullStr | A Validation System for the Complex Event Processing Directives of the ATLAS Shifter Assistant Tool |
title_full_unstemmed | A Validation System for the Complex Event Processing Directives of the ATLAS Shifter Assistant Tool |
title_short | A Validation System for the Complex Event Processing Directives of the ATLAS Shifter Assistant Tool |
title_sort | validation system for the complex event processing directives of the atlas shifter assistant tool |
topic | Particle Physics - Experiment |
url | http://cds.cern.ch/record/2005098 |
work_keys_str_mv | AT andersgabriel avalidationsystemforthecomplexeventprocessingdirectivesoftheatlasshifterassistanttool AT avoliogiuseppe avalidationsystemforthecomplexeventprocessingdirectivesoftheatlasshifterassistanttool AT kazarovandrei avalidationsystemforthecomplexeventprocessingdirectivesoftheatlasshifterassistanttool AT lehmannmiottogiovanna avalidationsystemforthecomplexeventprocessingdirectivesoftheatlasshifterassistanttool AT santosalejandro avalidationsystemforthecomplexeventprocessingdirectivesoftheatlasshifterassistanttool AT solovievigor avalidationsystemforthecomplexeventprocessingdirectivesoftheatlasshifterassistanttool AT andersgabriel validationsystemforthecomplexeventprocessingdirectivesoftheatlasshifterassistanttool AT avoliogiuseppe validationsystemforthecomplexeventprocessingdirectivesoftheatlasshifterassistanttool AT kazarovandrei validationsystemforthecomplexeventprocessingdirectivesoftheatlasshifterassistanttool AT lehmannmiottogiovanna validationsystemforthecomplexeventprocessingdirectivesoftheatlasshifterassistanttool AT santosalejandro validationsystemforthecomplexeventprocessingdirectivesoftheatlasshifterassistanttool AT solovievigor validationsystemforthecomplexeventprocessingdirectivesoftheatlasshifterassistanttool |