Cargando…

Recent Improvements in the ATLAS PanDA Pilot

The Production and Distributed Analysis system (PanDA) in the ATLAS experiment uses pilots to execute submitted jobs on the worker nodes. The pilots are designed to deal with different runtime conditions and failure scenarios, and support many storage systems. This talk will give a brief overview of...

Descripción completa

Detalles Bibliográficos
Autores principales: Nilsson, P, Caballero Bejar, J, Contreras, C, Compostella, G, De, K, Potekhin, M, Dos Santos, T, Maeno, T, Wenaus, T
Lenguaje:eng
Publicado: 2012
Materias:
Acceso en línea:https://dx.doi.org/10.1088/1742-6596/396/3/032080
http://cds.cern.ch/record/1450074
_version_ 1780924901611274240
author Nilsson, P
Caballero Bejar, J
Contreras, C
Compostella, G
De, K
Potekhin, M
Dos Santos, T
Maeno, T
Wenaus, T
author_facet Nilsson, P
Caballero Bejar, J
Contreras, C
Compostella, G
De, K
Potekhin, M
Dos Santos, T
Maeno, T
Wenaus, T
author_sort Nilsson, P
collection CERN
description The Production and Distributed Analysis system (PanDA) in the ATLAS experiment uses pilots to execute submitted jobs on the worker nodes. The pilots are designed to deal with different runtime conditions and failure scenarios, and support many storage systems. This talk will give a brief overview of the PanDA pilot system and will present major features and recent improvements including CernVM File System integration, the job retry mechanism, advanced job monitoring including JEM technology, and validation of new pilot code using the HammerCloud stress-testing system. PanDA is used for all ATLAS distributed production and is the primary system for distributed analysis. It is currently used at over 100 sites world-wide. We analyze the performance of the pilot system in processing LHC data on the OSG, EGI and Nordugrid infrastructures used by ATLAS, and describe plans for its further evolution.
id cern-1450074
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2012
record_format invenio
spelling cern-14500742019-09-30T06:29:59Zdoi:10.1088/1742-6596/396/3/032080http://cds.cern.ch/record/1450074engNilsson, PCaballero Bejar, JContreras, CCompostella, GDe, KPotekhin, MDos Santos, TMaeno, TWenaus, TRecent Improvements in the ATLAS PanDA PilotDetectors and Experimental TechniquesThe Production and Distributed Analysis system (PanDA) in the ATLAS experiment uses pilots to execute submitted jobs on the worker nodes. The pilots are designed to deal with different runtime conditions and failure scenarios, and support many storage systems. This talk will give a brief overview of the PanDA pilot system and will present major features and recent improvements including CernVM File System integration, the job retry mechanism, advanced job monitoring including JEM technology, and validation of new pilot code using the HammerCloud stress-testing system. PanDA is used for all ATLAS distributed production and is the primary system for distributed analysis. It is currently used at over 100 sites world-wide. We analyze the performance of the pilot system in processing LHC data on the OSG, EGI and Nordugrid infrastructures used by ATLAS, and describe plans for its further evolution.ATL-SOFT-PROC-2012-041oai:cds.cern.ch:14500742012-05-20
spellingShingle Detectors and Experimental Techniques
Nilsson, P
Caballero Bejar, J
Contreras, C
Compostella, G
De, K
Potekhin, M
Dos Santos, T
Maeno, T
Wenaus, T
Recent Improvements in the ATLAS PanDA Pilot
title Recent Improvements in the ATLAS PanDA Pilot
title_full Recent Improvements in the ATLAS PanDA Pilot
title_fullStr Recent Improvements in the ATLAS PanDA Pilot
title_full_unstemmed Recent Improvements in the ATLAS PanDA Pilot
title_short Recent Improvements in the ATLAS PanDA Pilot
title_sort recent improvements in the atlas panda pilot
topic Detectors and Experimental Techniques
url https://dx.doi.org/10.1088/1742-6596/396/3/032080
http://cds.cern.ch/record/1450074
work_keys_str_mv AT nilssonp recentimprovementsintheatlaspandapilot
AT caballerobejarj recentimprovementsintheatlaspandapilot
AT contrerasc recentimprovementsintheatlaspandapilot
AT compostellag recentimprovementsintheatlaspandapilot
AT dek recentimprovementsintheatlaspandapilot
AT potekhinm recentimprovementsintheatlaspandapilot
AT dossantost recentimprovementsintheatlaspandapilot
AT maenot recentimprovementsintheatlaspandapilot
AT wenaust recentimprovementsintheatlaspandapilot