Cargando…
Monitoring of computing resource utilization of the ATLAS experiment
Due to the good performance of the LHC accelerator, the ATLAS experiment has seen higher than anticipated levels for both the event rate and the average number of interactions per bunch crossing. In order to respond to these changing requirements, the current and future usage of CPU, memory and disk...
Autores principales: | , , , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2012
|
Materias: | |
Acceso en línea: | http://cds.cern.ch/record/1448169 |
_version_ | 1780924844994461696 |
---|---|
author | Rousseau, D Dimitrov, G Vukotic, I Aidel, O Schaffer, RD Albrand, S |
author_facet | Rousseau, D Dimitrov, G Vukotic, I Aidel, O Schaffer, RD Albrand, S |
author_sort | Rousseau, D |
collection | CERN |
description | Due to the good performance of the LHC accelerator, the ATLAS experiment has seen higher than anticipated levels for both the event rate and the average number of interactions per bunch crossing. In order to respond to these changing requirements, the current and future usage of CPU, memory and disk resources has to be monitored, understood and acted upon. This requires data collection at a fairly fine level of granularity: the performance of each object written and each algorithm run, as well as a dozen per-job variables, are gathered for the different processing steps of Monte Carlo generation and simulation and the reconstruction of both data and Monte Carlo. We present a system to collect and visualize the data from both the online Tier-0 system and distributed grid production jobs. Around 40 GB of performance data are expected from up to 200k jobs per day, thus making performance optimization of the underlying Oracle database of utmost importance. |
id | cern-1448169 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2012 |
record_format | invenio |
spelling | cern-14481692019-09-30T06:29:59Zhttp://cds.cern.ch/record/1448169engRousseau, DDimitrov, GVukotic, IAidel, OSchaffer, RDAlbrand, SMonitoring of computing resource utilization of the ATLAS experimentDetectors and Experimental TechniquesDue to the good performance of the LHC accelerator, the ATLAS experiment has seen higher than anticipated levels for both the event rate and the average number of interactions per bunch crossing. In order to respond to these changing requirements, the current and future usage of CPU, memory and disk resources has to be monitored, understood and acted upon. This requires data collection at a fairly fine level of granularity: the performance of each object written and each algorithm run, as well as a dozen per-job variables, are gathered for the different processing steps of Monte Carlo generation and simulation and the reconstruction of both data and Monte Carlo. We present a system to collect and visualize the data from both the online Tier-0 system and distributed grid production jobs. Around 40 GB of performance data are expected from up to 200k jobs per day, thus making performance optimization of the underlying Oracle database of utmost importance.ATL-SOFT-SLIDE-2012-198oai:cds.cern.ch:14481692012-05-12 |
spellingShingle | Detectors and Experimental Techniques Rousseau, D Dimitrov, G Vukotic, I Aidel, O Schaffer, RD Albrand, S Monitoring of computing resource utilization of the ATLAS experiment |
title | Monitoring of computing resource utilization of the ATLAS experiment |
title_full | Monitoring of computing resource utilization of the ATLAS experiment |
title_fullStr | Monitoring of computing resource utilization of the ATLAS experiment |
title_full_unstemmed | Monitoring of computing resource utilization of the ATLAS experiment |
title_short | Monitoring of computing resource utilization of the ATLAS experiment |
title_sort | monitoring of computing resource utilization of the atlas experiment |
topic | Detectors and Experimental Techniques |
url | http://cds.cern.ch/record/1448169 |
work_keys_str_mv | AT rousseaud monitoringofcomputingresourceutilizationoftheatlasexperiment AT dimitrovg monitoringofcomputingresourceutilizationoftheatlasexperiment AT vukotici monitoringofcomputingresourceutilizationoftheatlasexperiment AT aidelo monitoringofcomputingresourceutilizationoftheatlasexperiment AT schafferrd monitoringofcomputingresourceutilizationoftheatlasexperiment AT albrands monitoringofcomputingresourceutilizationoftheatlasexperiment |