Cargando…

Accounting and monitoring tools enhancement for Run 3 in the ATLAS distributed computing

The ATLAS experiment at the LHC utilizes complex multicomponent distributed systems for processing (PanDA WMS) and managing (Rucio) data. The complexity of the relationships between components, the amount of data being processed and the continuous development of new functionalities of the critical s...

Descripción completa

Detalles Bibliográficos
Autores principales: Alekseev, Aleksandr, Barberis, Dario, Svatos, Michal
Lenguaje:eng
Publicado: 2023
Materias:
Acceso en línea:http://cds.cern.ch/record/2869031
_version_ 1780978256299687936
author Alekseev, Aleksandr
Barberis, Dario
Svatos, Michal
author_facet Alekseev, Aleksandr
Barberis, Dario
Svatos, Michal
author_sort Alekseev, Aleksandr
collection CERN
description The ATLAS experiment at the LHC utilizes complex multicomponent distributed systems for processing (PanDA WMS) and managing (Rucio) data. The complexity of the relationships between components, the amount of data being processed and the continuous development of new functionalities of the critical systems are the main challenges to consider when creating monitoring and accounting tools able to adapt to this dynamic environment in a short time. To overcome these challenges, ATLAS uses the unified monitoring infrastructure (UMA) provided by CERN-IT since 2018, which accumulates information from distributed data sources and then makes it available for different ATLAS distributed computing user groups. The information is displayed using Grafana dashboards. Based on the information provided, they can be grouped as “data transfers'', “site accounting”, “jobs accounting” and so on. These monitoring tools are used daily by ATLAS members to spot and fix issues. In addition, LHC Run 3 required the implementation of significant changes in the monitoring and accounting infrastructure to collect and process data collected by ATLAS during LHC run. This paper describes the recent enhancements to the UMA-based monitoring and accounting dashboards.
id cern-2869031
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2023
record_format invenio
spelling cern-28690312023-08-31T18:34:38Zhttp://cds.cern.ch/record/2869031engAlekseev, AleksandrBarberis, DarioSvatos, MichalAccounting and monitoring tools enhancement for Run 3 in the ATLAS distributed computingParticle Physics - ExperimentThe ATLAS experiment at the LHC utilizes complex multicomponent distributed systems for processing (PanDA WMS) and managing (Rucio) data. The complexity of the relationships between components, the amount of data being processed and the continuous development of new functionalities of the critical systems are the main challenges to consider when creating monitoring and accounting tools able to adapt to this dynamic environment in a short time. To overcome these challenges, ATLAS uses the unified monitoring infrastructure (UMA) provided by CERN-IT since 2018, which accumulates information from distributed data sources and then makes it available for different ATLAS distributed computing user groups. The information is displayed using Grafana dashboards. Based on the information provided, they can be grouped as “data transfers'', “site accounting”, “jobs accounting” and so on. These monitoring tools are used daily by ATLAS members to spot and fix issues. In addition, LHC Run 3 required the implementation of significant changes in the monitoring and accounting infrastructure to collect and process data collected by ATLAS during LHC run. This paper describes the recent enhancements to the UMA-based monitoring and accounting dashboards.ATL-SOFT-PROC-2023-017oai:cds.cern.ch:28690312023-08-31
spellingShingle Particle Physics - Experiment
Alekseev, Aleksandr
Barberis, Dario
Svatos, Michal
Accounting and monitoring tools enhancement for Run 3 in the ATLAS distributed computing
title Accounting and monitoring tools enhancement for Run 3 in the ATLAS distributed computing
title_full Accounting and monitoring tools enhancement for Run 3 in the ATLAS distributed computing
title_fullStr Accounting and monitoring tools enhancement for Run 3 in the ATLAS distributed computing
title_full_unstemmed Accounting and monitoring tools enhancement for Run 3 in the ATLAS distributed computing
title_short Accounting and monitoring tools enhancement for Run 3 in the ATLAS distributed computing
title_sort accounting and monitoring tools enhancement for run 3 in the atlas distributed computing
topic Particle Physics - Experiment
url http://cds.cern.ch/record/2869031
work_keys_str_mv AT alekseevaleksandr accountingandmonitoringtoolsenhancementforrun3intheatlasdistributedcomputing
AT barberisdario accountingandmonitoringtoolsenhancementforrun3intheatlasdistributedcomputing
AT svatosmichal accountingandmonitoringtoolsenhancementforrun3intheatlasdistributedcomputing