Cargando…

Accounting and monitoring tools enhancement for Run 3 in the ATLAS distributed computing

The ATLAS experiment at the LHC utilizes complex multicomponent distributed systems for processing (PanDA WMS) and managing (Rucio) of data. The complexity of the relationships between components, the amount of data being processed and the continuous development of new functionality of the critical...

Descripción completa

Detalles Bibliográficos
Autores principales: Alekseev, Aleksandr, Barberis, Dario, Svatos, Michal
Lenguaje:eng
Publicado: 2023
Materias:
Acceso en línea:http://cds.cern.ch/record/2857829
Descripción
Sumario:The ATLAS experiment at the LHC utilizes complex multicomponent distributed systems for processing (PanDA WMS) and managing (Rucio) of data. The complexity of the relationships between components, the amount of data being processed and the continuous development of new functionality of the critical systems are the main challenges to consider when creating monitoring and accounting tools able to adapt to the dynamic environment in a short time. To overcome these challenges, ATLAS uses the unified monitoring infrastructure (UMA) provided by CERN-IT since 2018, which accumulates information from distributed data sources and then makes it available for different ATLAS distributed computing user groups. The information is displayed using Grafana dashboards. Based on the information provided, they can be grouped as “data transfers'', “site accounting”, “jobs accounting” and so on. These monitoring tools are used daily by ATLAS users to spot and fix issues. In addition, LHC Run 3 required the implementation of significant changes in the monitoring and accounting infrastructure to collect and process data collected by ATLAS during LHC run. This paper describes the recent enhancements to the UMA-based monitoring and accounting dashboards.