Cargando…

Recent Improvements in the ATLAS PanDA Pilot

The Production and Distributed Analysis system (PanDA) in the ATLAS experiment uses pilots to execute submitted jobs on the worker nodes. The pilots are designed to deal with different runtime conditions and failure scenarios, and support many storage systems. This talk will give a brief overview of...

Descripción completa

Detalles Bibliográficos
Autor principal: Nilsson, P
Lenguaje:eng
Publicado: 2012
Materias:
Acceso en línea:http://cds.cern.ch/record/1446286
_version_ 1780924788896694272
author Nilsson, P
author_facet Nilsson, P
author_sort Nilsson, P
collection CERN
description The Production and Distributed Analysis system (PanDA) in the ATLAS experiment uses pilots to execute submitted jobs on the worker nodes. The pilots are designed to deal with different runtime conditions and failure scenarios, and support many storage systems. This talk will give a brief overview of the PanDA pilot system and will present major features and recent improvements including CernVM File System integration, the job retry mechanism, advanced job monitoring including JEM technology, and validation of new pilot code using the HammerCloud stress-testing system. PanDA is used for all ATLAS distributed production and is the primary system for distributed analysis. It is currently used at over 100 sites world-wide. We analyze the performance of the pilot system in processing LHC data on the OSG, EGI and Nordugrid infrastructures used by ATLAS, and describe plans for its further evolution.
id cern-1446286
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2012
record_format invenio
spelling cern-14462862019-09-30T06:29:59Zhttp://cds.cern.ch/record/1446286engNilsson, PRecent Improvements in the ATLAS PanDA PilotDetectors and Experimental TechniquesThe Production and Distributed Analysis system (PanDA) in the ATLAS experiment uses pilots to execute submitted jobs on the worker nodes. The pilots are designed to deal with different runtime conditions and failure scenarios, and support many storage systems. This talk will give a brief overview of the PanDA pilot system and will present major features and recent improvements including CernVM File System integration, the job retry mechanism, advanced job monitoring including JEM technology, and validation of new pilot code using the HammerCloud stress-testing system. PanDA is used for all ATLAS distributed production and is the primary system for distributed analysis. It is currently used at over 100 sites world-wide. We analyze the performance of the pilot system in processing LHC data on the OSG, EGI and Nordugrid infrastructures used by ATLAS, and describe plans for its further evolution.ATL-SOFT-SLIDE-2012-180oai:cds.cern.ch:14462862012-05-07
spellingShingle Detectors and Experimental Techniques
Nilsson, P
Recent Improvements in the ATLAS PanDA Pilot
title Recent Improvements in the ATLAS PanDA Pilot
title_full Recent Improvements in the ATLAS PanDA Pilot
title_fullStr Recent Improvements in the ATLAS PanDA Pilot
title_full_unstemmed Recent Improvements in the ATLAS PanDA Pilot
title_short Recent Improvements in the ATLAS PanDA Pilot
title_sort recent improvements in the atlas panda pilot
topic Detectors and Experimental Techniques
url http://cds.cern.ch/record/1446286
work_keys_str_mv AT nilssonp recentimprovementsintheatlaspandapilot