Cargando…
MONIT: Monitoring the CERN Data Centres and the WLCG Infrastructure
The new unified monitoring architecture (MONIT) for the CERN Data Centres and for the WLCG Infrastructure is based on established open source technologies to collect, stream, store and access monitoring data. The previous solutions, based on in-house development and commercial software, have been re...
Autores principales: | , , , , , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2019
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1051/epjconf/201921408031 http://cds.cern.ch/record/2698538 |
_version_ | 1780964343094968320 |
---|---|
author | Aimar, Alberto Aguado Corman, Asier Andrade, Pedro Delgado Fernandez, Javier Garrido Bear, Borja Karavakis, Edward Kulikowski, Dominik Marek Magnoni, Luca |
author_facet | Aimar, Alberto Aguado Corman, Asier Andrade, Pedro Delgado Fernandez, Javier Garrido Bear, Borja Karavakis, Edward Kulikowski, Dominik Marek Magnoni, Luca |
author_sort | Aimar, Alberto |
collection | CERN |
description | The new unified monitoring architecture (MONIT) for the CERN Data Centres and for the WLCG Infrastructure is based on established open source technologies to collect, stream, store and access monitoring data. The previous solutions, based on in-house development and commercial software, have been replaced with widely- recognized technologies such as Collectd, Kafka, Spark, Elasticsearch, InfluxDB, Grafana and others. The monitoring infrastructure, fully based on CERN cloud resources, covers the whole workflow of the monitoring data: from collecting and validating metrics and logs to making them available for dashboards, reports and alarms. The deployment in production of this new DC and WLCG monitoring is well under way and this contribution provides a summary of the progress, hurdles met and lessons learned in using these open source technologies. It also focuses on the choices made to achieve the required levels of stability, scalability and performance of the MONIT monitoring service. |
id | oai-inspirehep.net-1761629 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2019 |
record_format | invenio |
spelling | oai-inspirehep.net-17616292022-08-10T12:25:02Zdoi:10.1051/epjconf/201921408031http://cds.cern.ch/record/2698538engAimar, AlbertoAguado Corman, AsierAndrade, PedroDelgado Fernandez, JavierGarrido Bear, BorjaKaravakis, EdwardKulikowski, Dominik MarekMagnoni, LucaMONIT: Monitoring the CERN Data Centres and the WLCG InfrastructureComputing and ComputersThe new unified monitoring architecture (MONIT) for the CERN Data Centres and for the WLCG Infrastructure is based on established open source technologies to collect, stream, store and access monitoring data. The previous solutions, based on in-house development and commercial software, have been replaced with widely- recognized technologies such as Collectd, Kafka, Spark, Elasticsearch, InfluxDB, Grafana and others. The monitoring infrastructure, fully based on CERN cloud resources, covers the whole workflow of the monitoring data: from collecting and validating metrics and logs to making them available for dashboards, reports and alarms. The deployment in production of this new DC and WLCG monitoring is well under way and this contribution provides a summary of the progress, hurdles met and lessons learned in using these open source technologies. It also focuses on the choices made to achieve the required levels of stability, scalability and performance of the MONIT monitoring service.oai:inspirehep.net:17616292019 |
spellingShingle | Computing and Computers Aimar, Alberto Aguado Corman, Asier Andrade, Pedro Delgado Fernandez, Javier Garrido Bear, Borja Karavakis, Edward Kulikowski, Dominik Marek Magnoni, Luca MONIT: Monitoring the CERN Data Centres and the WLCG Infrastructure |
title | MONIT: Monitoring the CERN Data Centres and the WLCG Infrastructure |
title_full | MONIT: Monitoring the CERN Data Centres and the WLCG Infrastructure |
title_fullStr | MONIT: Monitoring the CERN Data Centres and the WLCG Infrastructure |
title_full_unstemmed | MONIT: Monitoring the CERN Data Centres and the WLCG Infrastructure |
title_short | MONIT: Monitoring the CERN Data Centres and the WLCG Infrastructure |
title_sort | monit: monitoring the cern data centres and the wlcg infrastructure |
topic | Computing and Computers |
url | https://dx.doi.org/10.1051/epjconf/201921408031 http://cds.cern.ch/record/2698538 |
work_keys_str_mv | AT aimaralberto monitmonitoringthecerndatacentresandthewlcginfrastructure AT aguadocormanasier monitmonitoringthecerndatacentresandthewlcginfrastructure AT andradepedro monitmonitoringthecerndatacentresandthewlcginfrastructure AT delgadofernandezjavier monitmonitoringthecerndatacentresandthewlcginfrastructure AT garridobearborja monitmonitoringthecerndatacentresandthewlcginfrastructure AT karavakisedward monitmonitoringthecerndatacentresandthewlcginfrastructure AT kulikowskidominikmarek monitmonitoringthecerndatacentresandthewlcginfrastructure AT magnoniluca monitmonitoringthecerndatacentresandthewlcginfrastructure |