Cargando…

Implementation of ATLAS Distributed Computing monitoring dashboards using InfluxDB and Grafana

For the last 10 years, the ATLAS Distributed Computing project has based its monitoring infrastructure on a set of custom designed dashboards provided by CERN-IT. This system functioned very well for LHC Runs 1 and 2, but its maintenance has progressively become more difficult and the conditions for...

Descripción completa

Detalles Bibliográficos
Autores principales: Beermann, Thomas Alfons, Alekseev, Aleksandr, Barberis, Dario, Crépé-Renaudin, Sabine, Elmsheuser, Johannes, Glushkov, Ivan, Svatos, Michal, Vartapetian, Armen, Vokac, Petr, Wolters, Helmut
Lenguaje:eng
Publicado: 2019
Materias:
Acceso en línea:http://cds.cern.ch/record/2693712
_version_ 1780964044869468160
author Beermann, Thomas Alfons
Alekseev, Aleksandr
Barberis, Dario
Crépé-Renaudin, Sabine
Elmsheuser, Johannes
Glushkov, Ivan
Svatos, Michal
Vartapetian, Armen
Vokac, Petr
Wolters, Helmut
author_facet Beermann, Thomas Alfons
Alekseev, Aleksandr
Barberis, Dario
Crépé-Renaudin, Sabine
Elmsheuser, Johannes
Glushkov, Ivan
Svatos, Michal
Vartapetian, Armen
Vokac, Petr
Wolters, Helmut
author_sort Beermann, Thomas Alfons
collection CERN
description For the last 10 years, the ATLAS Distributed Computing project has based its monitoring infrastructure on a set of custom designed dashboards provided by CERN-IT. This system functioned very well for LHC Runs 1 and 2, but its maintenance has progressively become more difficult and the conditions for Run 3, starting in 2021, will be even more demanding; hence a more standard code base and more automatic operations are needed. A new infrastructure has been provided by the CERN-IT Monit group, based on InfluxDB as the data store and Grafana as the display environment. ATLAS has adapted and further developed its monitoring tools to use this infrastructure for data and workflow management monitoring and accounting dashboards, expanding the range of previous possibilities with the aim of achieving a single, simpler, environment for all monitoring applications. This presentation will describe the tools used, the data flows for monitoring and accounting, the problems encountered and the solutions found.
id cern-2693712
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2019
record_format invenio
spelling cern-26937122019-10-16T18:40:34Zhttp://cds.cern.ch/record/2693712engBeermann, Thomas AlfonsAlekseev, AleksandrBarberis, DarioCrépé-Renaudin, SabineElmsheuser, JohannesGlushkov, IvanSvatos, MichalVartapetian, ArmenVokac, PetrWolters, HelmutImplementation of ATLAS Distributed Computing monitoring dashboards using InfluxDB and GrafanaParticle Physics - ExperimentFor the last 10 years, the ATLAS Distributed Computing project has based its monitoring infrastructure on a set of custom designed dashboards provided by CERN-IT. This system functioned very well for LHC Runs 1 and 2, but its maintenance has progressively become more difficult and the conditions for Run 3, starting in 2021, will be even more demanding; hence a more standard code base and more automatic operations are needed. A new infrastructure has been provided by the CERN-IT Monit group, based on InfluxDB as the data store and Grafana as the display environment. ATLAS has adapted and further developed its monitoring tools to use this infrastructure for data and workflow management monitoring and accounting dashboards, expanding the range of previous possibilities with the aim of achieving a single, simpler, environment for all monitoring applications. This presentation will describe the tools used, the data flows for monitoring and accounting, the problems encountered and the solutions found.ATL-SOFT-SLIDE-2019-772oai:cds.cern.ch:26937122019-10-16
spellingShingle Particle Physics - Experiment
Beermann, Thomas Alfons
Alekseev, Aleksandr
Barberis, Dario
Crépé-Renaudin, Sabine
Elmsheuser, Johannes
Glushkov, Ivan
Svatos, Michal
Vartapetian, Armen
Vokac, Petr
Wolters, Helmut
Implementation of ATLAS Distributed Computing monitoring dashboards using InfluxDB and Grafana
title Implementation of ATLAS Distributed Computing monitoring dashboards using InfluxDB and Grafana
title_full Implementation of ATLAS Distributed Computing monitoring dashboards using InfluxDB and Grafana
title_fullStr Implementation of ATLAS Distributed Computing monitoring dashboards using InfluxDB and Grafana
title_full_unstemmed Implementation of ATLAS Distributed Computing monitoring dashboards using InfluxDB and Grafana
title_short Implementation of ATLAS Distributed Computing monitoring dashboards using InfluxDB and Grafana
title_sort implementation of atlas distributed computing monitoring dashboards using influxdb and grafana
topic Particle Physics - Experiment
url http://cds.cern.ch/record/2693712
work_keys_str_mv AT beermannthomasalfons implementationofatlasdistributedcomputingmonitoringdashboardsusinginfluxdbandgrafana
AT alekseevaleksandr implementationofatlasdistributedcomputingmonitoringdashboardsusinginfluxdbandgrafana
AT barberisdario implementationofatlasdistributedcomputingmonitoringdashboardsusinginfluxdbandgrafana
AT creperenaudinsabine implementationofatlasdistributedcomputingmonitoringdashboardsusinginfluxdbandgrafana
AT elmsheuserjohannes implementationofatlasdistributedcomputingmonitoringdashboardsusinginfluxdbandgrafana
AT glushkovivan implementationofatlasdistributedcomputingmonitoringdashboardsusinginfluxdbandgrafana
AT svatosmichal implementationofatlasdistributedcomputingmonitoringdashboardsusinginfluxdbandgrafana
AT vartapetianarmen implementationofatlasdistributedcomputingmonitoringdashboardsusinginfluxdbandgrafana
AT vokacpetr implementationofatlasdistributedcomputingmonitoringdashboardsusinginfluxdbandgrafana
AT woltershelmut implementationofatlasdistributedcomputingmonitoringdashboardsusinginfluxdbandgrafana