Cargando…
Online Production Validation in a HEP environment
In high energy physics (HEP) event simulations, petabytes of data are processed and stored requiring millions of CPU-years. This enormous demand for computing resources is handled by centers distributed worldwide, which form part of the LHC computing grid. The consumption of such an important amount...
Autores principales: | , , , , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2016
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1140/epjc/s10052-017-4755-3 http://cds.cern.ch/record/2236685 |
_version_ | 1780952837276041216 |
---|---|
author | Harenberg, T. Lang, N. Mättig, P. Sandhoff, M. Volkmer, F. Kuhl, T. Schwanenberger, C. |
author_facet | Harenberg, T. Lang, N. Mättig, P. Sandhoff, M. Volkmer, F. Kuhl, T. Schwanenberger, C. |
author_sort | Harenberg, T. |
collection | CERN |
description | In high energy physics (HEP) event simulations, petabytes of data are processed and stored requiring millions of CPU-years. This enormous demand for computing resources is handled by centers distributed worldwide, which form part of the LHC computing grid. The consumption of such an important amount of resources demands for an efficient production of simulation and for the early detection of potential errors. In this article we present a new monitoring framework for grid environments, which polls a measure of data quality during job execution. This online monitoring facilitates the early detection of configuration errors (specially in simulation parameters), and may thus contribute to significant savings in computing resources. |
id | cern-2236685 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2016 |
record_format | invenio |
spelling | cern-22366852023-05-16T08:35:34Zdoi:10.1140/epjc/s10052-017-4755-3doi:10.1140/epjc/s10052-017-4755-3http://cds.cern.ch/record/2236685engHarenberg, T.Lang, N.Mättig, P.Sandhoff, M.Volkmer, F.Kuhl, T.Schwanenberger, C.Online Production Validation in a HEP environmenthep-exParticle Physics - Experimentphysics.ins-detDetectors and Experimental TechniquesIn high energy physics (HEP) event simulations, petabytes of data are processed and stored requiring millions of CPU-years. This enormous demand for computing resources is handled by centers distributed worldwide, which form part of the LHC computing grid. The consumption of such an important amount of resources demands for an efficient production of simulation and for the early detection of potential errors. In this article we present a new monitoring framework for grid environments, which polls a measure of data quality during job execution. This online monitoring facilitates the early detection of configuration errors (specially in simulation parameters), and may thus contribute to significant savings in computing resources.Petabytes of data are to be processed and stored requiring millions of CPU-years in high energy particle (HEP) physics event simulation. This enormous demand is handled in worldwide distributed computing centers as part of the LHC computing grid. These significant resources require a high quality and efficient production and the early detection of potential errors. In this article we present novel monitoring techniques in a Grid environment to collect quality measures during job execution. This allows online assessment of data quality information to avoid configuration errors or inappropriate settings of simulation parameters and therefore is able to save time and resources.arXiv:1611.10112oai:cds.cern.ch:22366852016-11-30 |
spellingShingle | hep-ex Particle Physics - Experiment physics.ins-det Detectors and Experimental Techniques Harenberg, T. Lang, N. Mättig, P. Sandhoff, M. Volkmer, F. Kuhl, T. Schwanenberger, C. Online Production Validation in a HEP environment |
title | Online Production Validation in a HEP environment |
title_full | Online Production Validation in a HEP environment |
title_fullStr | Online Production Validation in a HEP environment |
title_full_unstemmed | Online Production Validation in a HEP environment |
title_short | Online Production Validation in a HEP environment |
title_sort | online production validation in a hep environment |
topic | hep-ex Particle Physics - Experiment physics.ins-det Detectors and Experimental Techniques |
url | https://dx.doi.org/10.1140/epjc/s10052-017-4755-3 https://dx.doi.org/10.1140/epjc/s10052-017-4755-3 http://cds.cern.ch/record/2236685 |
work_keys_str_mv | AT harenbergt onlineproductionvalidationinahepenvironment AT langn onlineproductionvalidationinahepenvironment AT mattigp onlineproductionvalidationinahepenvironment AT sandhoffm onlineproductionvalidationinahepenvironment AT volkmerf onlineproductionvalidationinahepenvironment AT kuhlt onlineproductionvalidationinahepenvironment AT schwanenbergerc onlineproductionvalidationinahepenvironment |