Cargando…

ATLAS EventIndex monitoring system using the Kibana analytics and visualization platform

The ATLAS EventIndex is a data catalogue system that stores event-related metadata for all (real and simulated) ATLAS events, on all processing stages. As it consists of different components that depend on other applications (such as distributed storage, and different sources of information) we need...

Descripción completa

Detalles Bibliográficos
Autores principales: Barberis, Dario, Cardenas Zarate, Simon Ernesto, Favareto, Andrea, Fernandez Casani, Alvaro, Gallas, Elizabeth, Garcia Montoro, Carlos, Gonzalez de la Hoz, Santiago, Hrivnac, Julius, Malon, David, Prokoshin, Fedor, Salt, Jose, Sanchez, Javier, Toebbicke, Rainer, Yuan, Ruijun
Lenguaje:eng
Publicado: 2016
Materias:
Acceso en línea:https://dx.doi.org/10.1088/1742-6596/762/1/012004
http://cds.cern.ch/record/2136815
_version_ 1780949987620814848
author Barberis, Dario
Cardenas Zarate, Simon Ernesto
Favareto, Andrea
Fernandez Casani, Alvaro
Gallas, Elizabeth
Garcia Montoro, Carlos
Gonzalez de la Hoz, Santiago
Hrivnac, Julius
Malon, David
Prokoshin, Fedor
Salt, Jose
Sanchez, Javier
Toebbicke, Rainer
Yuan, Ruijun
author_facet Barberis, Dario
Cardenas Zarate, Simon Ernesto
Favareto, Andrea
Fernandez Casani, Alvaro
Gallas, Elizabeth
Garcia Montoro, Carlos
Gonzalez de la Hoz, Santiago
Hrivnac, Julius
Malon, David
Prokoshin, Fedor
Salt, Jose
Sanchez, Javier
Toebbicke, Rainer
Yuan, Ruijun
author_sort Barberis, Dario
collection CERN
description The ATLAS EventIndex is a data catalogue system that stores event-related metadata for all (real and simulated) ATLAS events, on all processing stages. As it consists of different components that depend on other applications (such as distributed storage, and different sources of information) we need to monitor the conditions of many heterogeneous subsystems, to make sure everything is working correctly. This paper describes how we gather information about the EventIndex components and related subsystems: the Producer-Consumer architecture for data collection, health parameters from the servers that run EventIndex components, EventIndex web interface status, and the Hadoop infrastructure that stores EventIndex data. This information is collected, processed, and then displayed using CERN service monitoring software based on the Kibana analytic and visualization package, provided by CERN IT Department. EventIndex monitoring is used both by the EventIndex team and ATLAS Distributed Computing shifts crew
id cern-2136815
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2016
record_format invenio
spelling cern-21368152019-09-30T06:29:59Zdoi:10.1088/1742-6596/762/1/012004http://cds.cern.ch/record/2136815engBarberis, DarioCardenas Zarate, Simon ErnestoFavareto, AndreaFernandez Casani, AlvaroGallas, ElizabethGarcia Montoro, CarlosGonzalez de la Hoz, SantiagoHrivnac, JuliusMalon, DavidProkoshin, FedorSalt, JoseSanchez, JavierToebbicke, RainerYuan, RuijunATLAS EventIndex monitoring system using the Kibana analytics and visualization platformParticle Physics - ExperimentThe ATLAS EventIndex is a data catalogue system that stores event-related metadata for all (real and simulated) ATLAS events, on all processing stages. As it consists of different components that depend on other applications (such as distributed storage, and different sources of information) we need to monitor the conditions of many heterogeneous subsystems, to make sure everything is working correctly. This paper describes how we gather information about the EventIndex components and related subsystems: the Producer-Consumer architecture for data collection, health parameters from the servers that run EventIndex components, EventIndex web interface status, and the Hadoop infrastructure that stores EventIndex data. This information is collected, processed, and then displayed using CERN service monitoring software based on the Kibana analytic and visualization package, provided by CERN IT Department. EventIndex monitoring is used both by the EventIndex team and ATLAS Distributed Computing shifts crewATL-SOFT-PROC-2016-004oai:cds.cern.ch:21368152016-03-04
spellingShingle Particle Physics - Experiment
Barberis, Dario
Cardenas Zarate, Simon Ernesto
Favareto, Andrea
Fernandez Casani, Alvaro
Gallas, Elizabeth
Garcia Montoro, Carlos
Gonzalez de la Hoz, Santiago
Hrivnac, Julius
Malon, David
Prokoshin, Fedor
Salt, Jose
Sanchez, Javier
Toebbicke, Rainer
Yuan, Ruijun
ATLAS EventIndex monitoring system using the Kibana analytics and visualization platform
title ATLAS EventIndex monitoring system using the Kibana analytics and visualization platform
title_full ATLAS EventIndex monitoring system using the Kibana analytics and visualization platform
title_fullStr ATLAS EventIndex monitoring system using the Kibana analytics and visualization platform
title_full_unstemmed ATLAS EventIndex monitoring system using the Kibana analytics and visualization platform
title_short ATLAS EventIndex monitoring system using the Kibana analytics and visualization platform
title_sort atlas eventindex monitoring system using the kibana analytics and visualization platform
topic Particle Physics - Experiment
url https://dx.doi.org/10.1088/1742-6596/762/1/012004
http://cds.cern.ch/record/2136815
work_keys_str_mv AT barberisdario atlaseventindexmonitoringsystemusingthekibanaanalyticsandvisualizationplatform
AT cardenaszaratesimonernesto atlaseventindexmonitoringsystemusingthekibanaanalyticsandvisualizationplatform
AT favaretoandrea atlaseventindexmonitoringsystemusingthekibanaanalyticsandvisualizationplatform
AT fernandezcasanialvaro atlaseventindexmonitoringsystemusingthekibanaanalyticsandvisualizationplatform
AT gallaselizabeth atlaseventindexmonitoringsystemusingthekibanaanalyticsandvisualizationplatform
AT garciamontorocarlos atlaseventindexmonitoringsystemusingthekibanaanalyticsandvisualizationplatform
AT gonzalezdelahozsantiago atlaseventindexmonitoringsystemusingthekibanaanalyticsandvisualizationplatform
AT hrivnacjulius atlaseventindexmonitoringsystemusingthekibanaanalyticsandvisualizationplatform
AT malondavid atlaseventindexmonitoringsystemusingthekibanaanalyticsandvisualizationplatform
AT prokoshinfedor atlaseventindexmonitoringsystemusingthekibanaanalyticsandvisualizationplatform
AT saltjose atlaseventindexmonitoringsystemusingthekibanaanalyticsandvisualizationplatform
AT sanchezjavier atlaseventindexmonitoringsystemusingthekibanaanalyticsandvisualizationplatform
AT toebbickerainer atlaseventindexmonitoringsystemusingthekibanaanalyticsandvisualizationplatform
AT yuanruijun atlaseventindexmonitoringsystemusingthekibanaanalyticsandvisualizationplatform