Cargando…

Prototyping Virtual Data Technologies in ATLAS Data Challenge 1 Production

For efficiency of the large production tasks distributed worldwide, it is essential to provide shared production management tools comprised of integratable and interoperable services. To enhance the ATLAS DC1 production toolkit, we introduced and tested a Virtual Data services component. For each ma...

Descripción completa

Detalles Bibliográficos
Autores principales: Vaniachine, A., Malon, D., Nevski, P., De, K.
Lenguaje:eng
Publicado: 2003
Materias:
Acceso en línea:http://cds.cern.ch/record/622187
_version_ 1780900421788762112
author Vaniachine, A.
Malon, D.
Nevski, P.
De, K.
author_facet Vaniachine, A.
Malon, D.
Nevski, P.
De, K.
author_sort Vaniachine, A.
collection CERN
description For efficiency of the large production tasks distributed worldwide, it is essential to provide shared production management tools comprised of integratable and interoperable services. To enhance the ATLAS DC1 production toolkit, we introduced and tested a Virtual Data services component. For each major data transformation step identified in the ATLAS data processing pipeline (event generation, detector simulation, background pile-up and digitization, etc) the Virtual Data Cookbook (VDC) catalogue encapsulates the specific data transformation knowledge and the validated parameters settings that must be provided before the data transformation invocation. To provide for local-remote transparency during DC1 production, the VDC database server delivered in a controlled way both the validated production parameters and the templated production recipes for thousands of the event generation and detector simulation jobs around the world, simplifying the production management solutions.
id cern-622187
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2003
record_format invenio
spelling cern-6221872023-03-14T17:05:58Zhttp://cds.cern.ch/record/622187engVaniachine, A.Malon, D.Nevski, P.De, K.Prototyping Virtual Data Technologies in ATLAS Data Challenge 1 ProductionComputing and ComputersFor efficiency of the large production tasks distributed worldwide, it is essential to provide shared production management tools comprised of integratable and interoperable services. To enhance the ATLAS DC1 production toolkit, we introduced and tested a Virtual Data services component. For each major data transformation step identified in the ATLAS data processing pipeline (event generation, detector simulation, background pile-up and digitization, etc) the Virtual Data Cookbook (VDC) catalogue encapsulates the specific data transformation knowledge and the validated parameters settings that must be provided before the data transformation invocation. To provide for local-remote transparency during DC1 production, the VDC database server delivered in a controlled way both the validated production parameters and the templated production recipes for thousands of the event generation and detector simulation jobs around the world, simplifying the production management solutions.For efficiency of the large production tasks distributed worldwide, it is essential to provide shared production management tools comprised of integratable and interoperable services. To enhance the ATLAS DC1 production toolkit, we introduced and tested a Virtual Data services component. For each major data transformation step identified in the ATLAS data processing pipeline (event generation, detector simulation, background pile-up and digitization, etc) the Virtual Data Cookbook (VDC) catalogue encapsulates the specific data transformation knowledge and the validated parameters settings that must be provided before the data transformation invocation. To provide for local-remote transparency during DC1 production, the VDC database server delivered in a controlled way both the validated production parameters and the templated production recipes for thousands of the event generation and detector simulation jobs around the world, simplifying the production management solutions.ANL-HEP-CP-03-049CHEP-2003-TUCP012cs/0306102ANL-HEP-CP-2003-049oai:cds.cern.ch:6221872003-06-16
spellingShingle Computing and Computers
Vaniachine, A.
Malon, D.
Nevski, P.
De, K.
Prototyping Virtual Data Technologies in ATLAS Data Challenge 1 Production
title Prototyping Virtual Data Technologies in ATLAS Data Challenge 1 Production
title_full Prototyping Virtual Data Technologies in ATLAS Data Challenge 1 Production
title_fullStr Prototyping Virtual Data Technologies in ATLAS Data Challenge 1 Production
title_full_unstemmed Prototyping Virtual Data Technologies in ATLAS Data Challenge 1 Production
title_short Prototyping Virtual Data Technologies in ATLAS Data Challenge 1 Production
title_sort prototyping virtual data technologies in atlas data challenge 1 production
topic Computing and Computers
url http://cds.cern.ch/record/622187
work_keys_str_mv AT vaniachinea prototypingvirtualdatatechnologiesinatlasdatachallenge1production
AT malond prototypingvirtualdatatechnologiesinatlasdatachallenge1production
AT nevskip prototypingvirtualdatatechnologiesinatlasdatachallenge1production
AT dek prototypingvirtualdatatechnologiesinatlasdatachallenge1production