Cargando…

Online Production Validation in a HEP environment

In high energy physics (HEP) event simulations, petabytes of data are processed and stored requiring millions of CPU-years. This enormous demand for computing resources is handled by centers distributed worldwide, which form part of the LHC computing grid. The consumption of such an important amount...

Descripción completa

Detalles Bibliográficos
Autores principales: Harenberg, T., Lang, N., Mättig, P., Sandhoff, M., Volkmer, F., Kuhl, T., Schwanenberger, C.
Lenguaje:eng
Publicado: 2016
Materias:
Acceso en línea:https://dx.doi.org/10.1140/epjc/s10052-017-4755-3
http://cds.cern.ch/record/2236685
_version_ 1780952837276041216
author Harenberg, T.
Lang, N.
Mättig, P.
Sandhoff, M.
Volkmer, F.
Kuhl, T.
Schwanenberger, C.
author_facet Harenberg, T.
Lang, N.
Mättig, P.
Sandhoff, M.
Volkmer, F.
Kuhl, T.
Schwanenberger, C.
author_sort Harenberg, T.
collection CERN
description In high energy physics (HEP) event simulations, petabytes of data are processed and stored requiring millions of CPU-years. This enormous demand for computing resources is handled by centers distributed worldwide, which form part of the LHC computing grid. The consumption of such an important amount of resources demands for an efficient production of simulation and for the early detection of potential errors. In this article we present a new monitoring framework for grid environments, which polls a measure of data quality during job execution. This online monitoring facilitates the early detection of configuration errors (specially in simulation parameters), and may thus contribute to significant savings in computing resources.
id cern-2236685
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2016
record_format invenio
spelling cern-22366852023-05-16T08:35:34Zdoi:10.1140/epjc/s10052-017-4755-3doi:10.1140/epjc/s10052-017-4755-3http://cds.cern.ch/record/2236685engHarenberg, T.Lang, N.Mättig, P.Sandhoff, M.Volkmer, F.Kuhl, T.Schwanenberger, C.Online Production Validation in a HEP environmenthep-exParticle Physics - Experimentphysics.ins-detDetectors and Experimental TechniquesIn high energy physics (HEP) event simulations, petabytes of data are processed and stored requiring millions of CPU-years. This enormous demand for computing resources is handled by centers distributed worldwide, which form part of the LHC computing grid. The consumption of such an important amount of resources demands for an efficient production of simulation and for the early detection of potential errors. In this article we present a new monitoring framework for grid environments, which polls a measure of data quality during job execution. This online monitoring facilitates the early detection of configuration errors (specially in simulation parameters), and may thus contribute to significant savings in computing resources.Petabytes of data are to be processed and stored requiring millions of CPU-years in high energy particle (HEP) physics event simulation. This enormous demand is handled in worldwide distributed computing centers as part of the LHC computing grid. These significant resources require a high quality and efficient production and the early detection of potential errors. In this article we present novel monitoring techniques in a Grid environment to collect quality measures during job execution. This allows online assessment of data quality information to avoid configuration errors or inappropriate settings of simulation parameters and therefore is able to save time and resources.arXiv:1611.10112oai:cds.cern.ch:22366852016-11-30
spellingShingle hep-ex
Particle Physics - Experiment
physics.ins-det
Detectors and Experimental Techniques
Harenberg, T.
Lang, N.
Mättig, P.
Sandhoff, M.
Volkmer, F.
Kuhl, T.
Schwanenberger, C.
Online Production Validation in a HEP environment
title Online Production Validation in a HEP environment
title_full Online Production Validation in a HEP environment
title_fullStr Online Production Validation in a HEP environment
title_full_unstemmed Online Production Validation in a HEP environment
title_short Online Production Validation in a HEP environment
title_sort online production validation in a hep environment
topic hep-ex
Particle Physics - Experiment
physics.ins-det
Detectors and Experimental Techniques
url https://dx.doi.org/10.1140/epjc/s10052-017-4755-3
https://dx.doi.org/10.1140/epjc/s10052-017-4755-3
http://cds.cern.ch/record/2236685
work_keys_str_mv AT harenbergt onlineproductionvalidationinahepenvironment
AT langn onlineproductionvalidationinahepenvironment
AT mattigp onlineproductionvalidationinahepenvironment
AT sandhoffm onlineproductionvalidationinahepenvironment
AT volkmerf onlineproductionvalidationinahepenvironment
AT kuhlt onlineproductionvalidationinahepenvironment
AT schwanenbergerc onlineproductionvalidationinahepenvironment