Cargando…

Simplified pilot module development and testing within the ATLAS PanDA Pilot 2.0 Project

The Production and Distributed Analysis (PanDA) system has been developed to meet ATLAS production and analysis requirements for a data-driven workload management system capable of operating at the LHC data processing scale. The PanDA pilot is one of the major components in the PanDA system. It runs...

Descripción completa

Detalles Bibliográficos
Autores principales: Drizhuk, Daniil, Guan, Wen, Nilsson, Paul
Lenguaje:eng
Publicado: 2016
Materias:
Acceso en línea:http://cds.cern.ch/record/2195809
_version_ 1780951078171312128
author Drizhuk, Daniil
Guan, Wen
Nilsson, Paul
author_facet Drizhuk, Daniil
Guan, Wen
Nilsson, Paul
author_sort Drizhuk, Daniil
collection CERN
description The Production and Distributed Analysis (PanDA) system has been developed to meet ATLAS production and analysis requirements for a data-driven workload management system capable of operating at the LHC data processing scale. The PanDA pilot is one of the major components in the PanDA system. It runs on a worker node and takes care of setting up the environment, fetching and pushing data to storage, getting jobs from the PanDA server and executing them. The original PanDA Pilot was designed over 10 years ago and has since then grown organically. Large parts of the original pilot code base are now getting old and are difficult to maintain. Incremental changes and refactoring have been pushed to the limit, and the time is now right for a fresh start, informed by a decade of experience, with the PanDA Pilot 2.0 Project. To create a testing environment for module development and automated unit and functional testing for next generation pilot tasks, a simple pilot version was developed. It resembles the basic workflow of pilot tasks used in production and provides a simple and clean template for module construction. The miniPilot has a simple structure and is easy to use for development, testing and debugging server-client interactions with new protocols and application interfaces. The unit and functional test system will be developed on top of the miniPilot, and will be used to run automatic tests. This presentation will describe the miniPilot and the test system that will be used during the Pilot 2.0 Project.
id cern-2195809
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2016
record_format invenio
spelling cern-21958092019-09-30T06:29:59Zhttp://cds.cern.ch/record/2195809engDrizhuk, DaniilGuan, WenNilsson, PaulSimplified pilot module development and testing within the ATLAS PanDA Pilot 2.0 ProjectParticle Physics - ExperimentThe Production and Distributed Analysis (PanDA) system has been developed to meet ATLAS production and analysis requirements for a data-driven workload management system capable of operating at the LHC data processing scale. The PanDA pilot is one of the major components in the PanDA system. It runs on a worker node and takes care of setting up the environment, fetching and pushing data to storage, getting jobs from the PanDA server and executing them. The original PanDA Pilot was designed over 10 years ago and has since then grown organically. Large parts of the original pilot code base are now getting old and are difficult to maintain. Incremental changes and refactoring have been pushed to the limit, and the time is now right for a fresh start, informed by a decade of experience, with the PanDA Pilot 2.0 Project. To create a testing environment for module development and automated unit and functional testing for next generation pilot tasks, a simple pilot version was developed. It resembles the basic workflow of pilot tasks used in production and provides a simple and clean template for module construction. The miniPilot has a simple structure and is easy to use for development, testing and debugging server-client interactions with new protocols and application interfaces. The unit and functional test system will be developed on top of the miniPilot, and will be used to run automatic tests. This presentation will describe the miniPilot and the test system that will be used during the Pilot 2.0 Project.ATL-SOFT-SLIDE-2016-372oai:cds.cern.ch:21958092016-07-01
spellingShingle Particle Physics - Experiment
Drizhuk, Daniil
Guan, Wen
Nilsson, Paul
Simplified pilot module development and testing within the ATLAS PanDA Pilot 2.0 Project
title Simplified pilot module development and testing within the ATLAS PanDA Pilot 2.0 Project
title_full Simplified pilot module development and testing within the ATLAS PanDA Pilot 2.0 Project
title_fullStr Simplified pilot module development and testing within the ATLAS PanDA Pilot 2.0 Project
title_full_unstemmed Simplified pilot module development and testing within the ATLAS PanDA Pilot 2.0 Project
title_short Simplified pilot module development and testing within the ATLAS PanDA Pilot 2.0 Project
title_sort simplified pilot module development and testing within the atlas panda pilot 2.0 project
topic Particle Physics - Experiment
url http://cds.cern.ch/record/2195809
work_keys_str_mv AT drizhukdaniil simplifiedpilotmoduledevelopmentandtestingwithintheatlaspandapilot20project
AT guanwen simplifiedpilotmoduledevelopmentandtestingwithintheatlaspandapilot20project
AT nilssonpaul simplifiedpilotmoduledevelopmentandtestingwithintheatlaspandapilot20project