Cargando…

The ATLAS BigPanDA Monitoring System Architecture

Currently-running large-scale scientific projects involve unprecedented amounts of data and computing power. For example, the ATLAS experiment at the Large Hadron Collider (LHC) has collected 140 PB of data over the course of Run 1 and this value increases at rate of ~800MB/s during the ongoing Run...

Descripción completa

Detalles Bibliográficos
Autores principales: Korchuganova, Tatiana, Padolski, Siarhei, Wenaus, Torre, Alekseev, Aleksandr, Klimentov, Alexei
Lenguaje:eng
Publicado: 2018
Materias:
Acceso en línea:http://cds.cern.ch/record/2646352
_version_ 1780960489849749504
author Korchuganova, Tatiana
Padolski, Siarhei
Wenaus, Torre
Alekseev, Aleksandr
Klimentov, Alexei
author_facet Korchuganova, Tatiana
Padolski, Siarhei
Wenaus, Torre
Alekseev, Aleksandr
Klimentov, Alexei
author_sort Korchuganova, Tatiana
collection CERN
description Currently-running large-scale scientific projects involve unprecedented amounts of data and computing power. For example, the ATLAS experiment at the Large Hadron Collider (LHC) has collected 140 PB of data over the course of Run 1 and this value increases at rate of ~800MB/s during the ongoing Run 2. Processing and analysis of such amounts of data demands development of complex operational workflow and payload systems along with building top edge computing facilities. In the ATLAS experiment a key element of the payload management is the Production and Distributed Analysis system (PanDA). It consists of several core components and one of them is the monitoring. The latter is responsible for providing a comprehensive and coherent view of the tasks and jobs executed by the system, from high level summaries to detailed drill-down job diagnostics. The BigPanDA monitoring has been in production since the middle of 2014 and it continuously evolves to satisfy increasing demands in functionality and growing payload scales. Today it effectively keeps track of more than 2 million jobs per day distributed over 170 computing centers worldwide in the largest instance of the BigPanDA monitoring: the ATLAS experiment. In this paper we describe the monitoring architecture and its principal features.
id cern-2646352
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2018
record_format invenio
spelling cern-26463522019-09-30T06:29:59Zhttp://cds.cern.ch/record/2646352engKorchuganova, TatianaPadolski, SiarheiWenaus, TorreAlekseev, AleksandrKlimentov, AlexeiThe ATLAS BigPanDA Monitoring System ArchitectureParticle Physics - ExperimentCurrently-running large-scale scientific projects involve unprecedented amounts of data and computing power. For example, the ATLAS experiment at the Large Hadron Collider (LHC) has collected 140 PB of data over the course of Run 1 and this value increases at rate of ~800MB/s during the ongoing Run 2. Processing and analysis of such amounts of data demands development of complex operational workflow and payload systems along with building top edge computing facilities. In the ATLAS experiment a key element of the payload management is the Production and Distributed Analysis system (PanDA). It consists of several core components and one of them is the monitoring. The latter is responsible for providing a comprehensive and coherent view of the tasks and jobs executed by the system, from high level summaries to detailed drill-down job diagnostics. The BigPanDA monitoring has been in production since the middle of 2014 and it continuously evolves to satisfy increasing demands in functionality and growing payload scales. Today it effectively keeps track of more than 2 million jobs per day distributed over 170 computing centers worldwide in the largest instance of the BigPanDA monitoring: the ATLAS experiment. In this paper we describe the monitoring architecture and its principal features.ATL-SOFT-PROC-2018-019oai:cds.cern.ch:26463522018-11-08
spellingShingle Particle Physics - Experiment
Korchuganova, Tatiana
Padolski, Siarhei
Wenaus, Torre
Alekseev, Aleksandr
Klimentov, Alexei
The ATLAS BigPanDA Monitoring System Architecture
title The ATLAS BigPanDA Monitoring System Architecture
title_full The ATLAS BigPanDA Monitoring System Architecture
title_fullStr The ATLAS BigPanDA Monitoring System Architecture
title_full_unstemmed The ATLAS BigPanDA Monitoring System Architecture
title_short The ATLAS BigPanDA Monitoring System Architecture
title_sort atlas bigpanda monitoring system architecture
topic Particle Physics - Experiment
url http://cds.cern.ch/record/2646352
work_keys_str_mv AT korchuganovatatiana theatlasbigpandamonitoringsystemarchitecture
AT padolskisiarhei theatlasbigpandamonitoringsystemarchitecture
AT wenaustorre theatlasbigpandamonitoringsystemarchitecture
AT alekseevaleksandr theatlasbigpandamonitoringsystemarchitecture
AT klimentovalexei theatlasbigpandamonitoringsystemarchitecture
AT korchuganovatatiana atlasbigpandamonitoringsystemarchitecture
AT padolskisiarhei atlasbigpandamonitoringsystemarchitecture
AT wenaustorre atlasbigpandamonitoringsystemarchitecture
AT alekseevaleksandr atlasbigpandamonitoringsystemarchitecture
AT klimentovalexei atlasbigpandamonitoringsystemarchitecture