Cargando…

Virtualised data production infrastructure for NA61/SHINE based on CernVM

Traditionally, the NA61/SHINE data production is performed by manually submitting jobs to the CERN batch system. An effort is now under way to migrate the data production to an automatic system, on top of a virtualised platform based on CernVM. This will make it easier to both initiate new data prod...

Descripción completa

Detalles Bibliográficos
Autor principal: Larsen, Dag Toppe
Lenguaje:eng
Publicado: 2014
Materias:
Acceso en línea:https://dx.doi.org/10.1088/1742-6596/513/3/032051
http://cds.cern.ch/record/2026319
_version_ 1780947346783207424
author Larsen, Dag Toppe
author_facet Larsen, Dag Toppe
author_sort Larsen, Dag Toppe
collection CERN
description Traditionally, the NA61/SHINE data production is performed by manually submitting jobs to the CERN batch system. An effort is now under way to migrate the data production to an automatic system, on top of a virtualised platform based on CernVM. This will make it easier to both initiate new data productions, and to utilise computing resources available outside CERN. In addition, there is a data preservation perspective. CernVM is a Linux distribution created by CERN specifically for the needs of virtual machines. Data production software and calibration data are distributed globally via the HTTP-based CernVM file system. The NA61/SHINE data production software has been adapted to run under CernVM through CernVM file system. Databases are used to keep track of the data. This will allow the system to present lists of both raw and produced data. If a new data production is needed, the privileged user may choose the data, software versions, and calibrations to be used. Finished jobs will be scanned for errors, and automatically resubmitted for processing if needed. A web-based, graphical user interface for the data production will be available. Finally, the relevant databases will be updated to reflect the freshly produced data.
id oai-inspirehep.net-1302020
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2014
record_format invenio
spelling oai-inspirehep.net-13020202022-08-17T13:29:06Zdoi:10.1088/1742-6596/513/3/032051http://cds.cern.ch/record/2026319engLarsen, Dag ToppeVirtualised data production infrastructure for NA61/SHINE based on CernVMComputing and ComputersTraditionally, the NA61/SHINE data production is performed by manually submitting jobs to the CERN batch system. An effort is now under way to migrate the data production to an automatic system, on top of a virtualised platform based on CernVM. This will make it easier to both initiate new data productions, and to utilise computing resources available outside CERN. In addition, there is a data preservation perspective. CernVM is a Linux distribution created by CERN specifically for the needs of virtual machines. Data production software and calibration data are distributed globally via the HTTP-based CernVM file system. The NA61/SHINE data production software has been adapted to run under CernVM through CernVM file system. Databases are used to keep track of the data. This will allow the system to present lists of both raw and produced data. If a new data production is needed, the privileged user may choose the data, software versions, and calibrations to be used. Finished jobs will be scanned for errors, and automatically resubmitted for processing if needed. A web-based, graphical user interface for the data production will be available. Finally, the relevant databases will be updated to reflect the freshly produced data.oai:inspirehep.net:13020202014
spellingShingle Computing and Computers
Larsen, Dag Toppe
Virtualised data production infrastructure for NA61/SHINE based on CernVM
title Virtualised data production infrastructure for NA61/SHINE based on CernVM
title_full Virtualised data production infrastructure for NA61/SHINE based on CernVM
title_fullStr Virtualised data production infrastructure for NA61/SHINE based on CernVM
title_full_unstemmed Virtualised data production infrastructure for NA61/SHINE based on CernVM
title_short Virtualised data production infrastructure for NA61/SHINE based on CernVM
title_sort virtualised data production infrastructure for na61/shine based on cernvm
topic Computing and Computers
url https://dx.doi.org/10.1088/1742-6596/513/3/032051
http://cds.cern.ch/record/2026319
work_keys_str_mv AT larsendagtoppe virtualiseddataproductioninfrastructureforna61shinebasedoncernvm