Cargando…
ATLAS EventIndex monitoring system using the Kibana analytics and visualization platform
The ATLAS EventIndex is a data catalogue system that stores event-related metadata for all (real and simulated) ATLAS events, on all processing stages. As it consists of different components that depend on other applications (such as distributed storage, and different sources of information) we need...
Autores principales: | , , , , , , , , , , , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2016
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1088/1742-6596/762/1/012004 http://cds.cern.ch/record/2136815 |
_version_ | 1780949987620814848 |
---|---|
author | Barberis, Dario Cardenas Zarate, Simon Ernesto Favareto, Andrea Fernandez Casani, Alvaro Gallas, Elizabeth Garcia Montoro, Carlos Gonzalez de la Hoz, Santiago Hrivnac, Julius Malon, David Prokoshin, Fedor Salt, Jose Sanchez, Javier Toebbicke, Rainer Yuan, Ruijun |
author_facet | Barberis, Dario Cardenas Zarate, Simon Ernesto Favareto, Andrea Fernandez Casani, Alvaro Gallas, Elizabeth Garcia Montoro, Carlos Gonzalez de la Hoz, Santiago Hrivnac, Julius Malon, David Prokoshin, Fedor Salt, Jose Sanchez, Javier Toebbicke, Rainer Yuan, Ruijun |
author_sort | Barberis, Dario |
collection | CERN |
description | The ATLAS EventIndex is a data catalogue system that stores event-related metadata for all (real and simulated) ATLAS events, on all processing stages. As it consists of different components that depend on other applications (such as distributed storage, and different sources of information) we need to monitor the conditions of many heterogeneous subsystems, to make sure everything is working correctly. This paper describes how we gather information about the EventIndex components and related subsystems: the Producer-Consumer architecture for data collection, health parameters from the servers that run EventIndex components, EventIndex web interface status, and the Hadoop infrastructure that stores EventIndex data. This information is collected, processed, and then displayed using CERN service monitoring software based on the Kibana analytic and visualization package, provided by CERN IT Department. EventIndex monitoring is used both by the EventIndex team and ATLAS Distributed Computing shifts crew |
id | cern-2136815 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2016 |
record_format | invenio |
spelling | cern-21368152019-09-30T06:29:59Zdoi:10.1088/1742-6596/762/1/012004http://cds.cern.ch/record/2136815engBarberis, DarioCardenas Zarate, Simon ErnestoFavareto, AndreaFernandez Casani, AlvaroGallas, ElizabethGarcia Montoro, CarlosGonzalez de la Hoz, SantiagoHrivnac, JuliusMalon, DavidProkoshin, FedorSalt, JoseSanchez, JavierToebbicke, RainerYuan, RuijunATLAS EventIndex monitoring system using the Kibana analytics and visualization platformParticle Physics - ExperimentThe ATLAS EventIndex is a data catalogue system that stores event-related metadata for all (real and simulated) ATLAS events, on all processing stages. As it consists of different components that depend on other applications (such as distributed storage, and different sources of information) we need to monitor the conditions of many heterogeneous subsystems, to make sure everything is working correctly. This paper describes how we gather information about the EventIndex components and related subsystems: the Producer-Consumer architecture for data collection, health parameters from the servers that run EventIndex components, EventIndex web interface status, and the Hadoop infrastructure that stores EventIndex data. This information is collected, processed, and then displayed using CERN service monitoring software based on the Kibana analytic and visualization package, provided by CERN IT Department. EventIndex monitoring is used both by the EventIndex team and ATLAS Distributed Computing shifts crewATL-SOFT-PROC-2016-004oai:cds.cern.ch:21368152016-03-04 |
spellingShingle | Particle Physics - Experiment Barberis, Dario Cardenas Zarate, Simon Ernesto Favareto, Andrea Fernandez Casani, Alvaro Gallas, Elizabeth Garcia Montoro, Carlos Gonzalez de la Hoz, Santiago Hrivnac, Julius Malon, David Prokoshin, Fedor Salt, Jose Sanchez, Javier Toebbicke, Rainer Yuan, Ruijun ATLAS EventIndex monitoring system using the Kibana analytics and visualization platform |
title | ATLAS EventIndex monitoring system using the Kibana analytics and visualization platform |
title_full | ATLAS EventIndex monitoring system using the Kibana analytics and visualization platform |
title_fullStr | ATLAS EventIndex monitoring system using the Kibana analytics and visualization platform |
title_full_unstemmed | ATLAS EventIndex monitoring system using the Kibana analytics and visualization platform |
title_short | ATLAS EventIndex monitoring system using the Kibana analytics and visualization platform |
title_sort | atlas eventindex monitoring system using the kibana analytics and visualization platform |
topic | Particle Physics - Experiment |
url | https://dx.doi.org/10.1088/1742-6596/762/1/012004 http://cds.cern.ch/record/2136815 |
work_keys_str_mv | AT barberisdario atlaseventindexmonitoringsystemusingthekibanaanalyticsandvisualizationplatform AT cardenaszaratesimonernesto atlaseventindexmonitoringsystemusingthekibanaanalyticsandvisualizationplatform AT favaretoandrea atlaseventindexmonitoringsystemusingthekibanaanalyticsandvisualizationplatform AT fernandezcasanialvaro atlaseventindexmonitoringsystemusingthekibanaanalyticsandvisualizationplatform AT gallaselizabeth atlaseventindexmonitoringsystemusingthekibanaanalyticsandvisualizationplatform AT garciamontorocarlos atlaseventindexmonitoringsystemusingthekibanaanalyticsandvisualizationplatform AT gonzalezdelahozsantiago atlaseventindexmonitoringsystemusingthekibanaanalyticsandvisualizationplatform AT hrivnacjulius atlaseventindexmonitoringsystemusingthekibanaanalyticsandvisualizationplatform AT malondavid atlaseventindexmonitoringsystemusingthekibanaanalyticsandvisualizationplatform AT prokoshinfedor atlaseventindexmonitoringsystemusingthekibanaanalyticsandvisualizationplatform AT saltjose atlaseventindexmonitoringsystemusingthekibanaanalyticsandvisualizationplatform AT sanchezjavier atlaseventindexmonitoringsystemusingthekibanaanalyticsandvisualizationplatform AT toebbickerainer atlaseventindexmonitoringsystemusingthekibanaanalyticsandvisualizationplatform AT yuanruijun atlaseventindexmonitoringsystemusingthekibanaanalyticsandvisualizationplatform |