Cargando…

Monitoring of computing resource utilization of the ATLAS experiment

Due to the good performance of the LHC accelerator, the ATLAS experiment has seen higher than anticipated levels for both the event rate and the average number of interactions per bunch crossing. In order to respond to these changing requirements, the current and future usage of CPU, memory and disk...

Descripción completa

Detalles Bibliográficos
Autores principales: Rousseau, D, Dimitrov, G, Vukotic, I, Aidel, O, Schaffer, RD, Albrand, S
Lenguaje:eng
Publicado: 2012
Materias:
Acceso en línea:http://cds.cern.ch/record/1448169
_version_ 1780924844994461696
author Rousseau, D
Dimitrov, G
Vukotic, I
Aidel, O
Schaffer, RD
Albrand, S
author_facet Rousseau, D
Dimitrov, G
Vukotic, I
Aidel, O
Schaffer, RD
Albrand, S
author_sort Rousseau, D
collection CERN
description Due to the good performance of the LHC accelerator, the ATLAS experiment has seen higher than anticipated levels for both the event rate and the average number of interactions per bunch crossing. In order to respond to these changing requirements, the current and future usage of CPU, memory and disk resources has to be monitored, understood and acted upon. This requires data collection at a fairly fine level of granularity: the performance of each object written and each algorithm run, as well as a dozen per-job variables, are gathered for the different processing steps of Monte Carlo generation and simulation and the reconstruction of both data and Monte Carlo. We present a system to collect and visualize the data from both the online Tier-0 system and distributed grid production jobs. Around 40 GB of performance data are expected from up to 200k jobs per day, thus making performance optimization of the underlying Oracle database of utmost importance.
id cern-1448169
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2012
record_format invenio
spelling cern-14481692019-09-30T06:29:59Zhttp://cds.cern.ch/record/1448169engRousseau, DDimitrov, GVukotic, IAidel, OSchaffer, RDAlbrand, SMonitoring of computing resource utilization of the ATLAS experimentDetectors and Experimental TechniquesDue to the good performance of the LHC accelerator, the ATLAS experiment has seen higher than anticipated levels for both the event rate and the average number of interactions per bunch crossing. In order to respond to these changing requirements, the current and future usage of CPU, memory and disk resources has to be monitored, understood and acted upon. This requires data collection at a fairly fine level of granularity: the performance of each object written and each algorithm run, as well as a dozen per-job variables, are gathered for the different processing steps of Monte Carlo generation and simulation and the reconstruction of both data and Monte Carlo. We present a system to collect and visualize the data from both the online Tier-0 system and distributed grid production jobs. Around 40 GB of performance data are expected from up to 200k jobs per day, thus making performance optimization of the underlying Oracle database of utmost importance.ATL-SOFT-SLIDE-2012-198oai:cds.cern.ch:14481692012-05-12
spellingShingle Detectors and Experimental Techniques
Rousseau, D
Dimitrov, G
Vukotic, I
Aidel, O
Schaffer, RD
Albrand, S
Monitoring of computing resource utilization of the ATLAS experiment
title Monitoring of computing resource utilization of the ATLAS experiment
title_full Monitoring of computing resource utilization of the ATLAS experiment
title_fullStr Monitoring of computing resource utilization of the ATLAS experiment
title_full_unstemmed Monitoring of computing resource utilization of the ATLAS experiment
title_short Monitoring of computing resource utilization of the ATLAS experiment
title_sort monitoring of computing resource utilization of the atlas experiment
topic Detectors and Experimental Techniques
url http://cds.cern.ch/record/1448169
work_keys_str_mv AT rousseaud monitoringofcomputingresourceutilizationoftheatlasexperiment
AT dimitrovg monitoringofcomputingresourceutilizationoftheatlasexperiment
AT vukotici monitoringofcomputingresourceutilizationoftheatlasexperiment
AT aidelo monitoringofcomputingresourceutilizationoftheatlasexperiment
AT schafferrd monitoringofcomputingresourceutilizationoftheatlasexperiment
AT albrands monitoringofcomputingresourceutilizationoftheatlasexperiment