Cargando…
Recent Improvements in the ATLAS PanDA Pilot
The Production and Distributed Analysis system (PanDA) in the ATLAS experiment uses pilots to execute submitted jobs on the worker nodes. The pilots are designed to deal with different runtime conditions and failure scenarios, and support many storage systems. This talk will give a brief overview of...
Autores principales: | , , , , , , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2012
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1088/1742-6596/396/3/032080 http://cds.cern.ch/record/1450074 |
_version_ | 1780924901611274240 |
---|---|
author | Nilsson, P Caballero Bejar, J Contreras, C Compostella, G De, K Potekhin, M Dos Santos, T Maeno, T Wenaus, T |
author_facet | Nilsson, P Caballero Bejar, J Contreras, C Compostella, G De, K Potekhin, M Dos Santos, T Maeno, T Wenaus, T |
author_sort | Nilsson, P |
collection | CERN |
description | The Production and Distributed Analysis system (PanDA) in the ATLAS experiment uses pilots to execute submitted jobs on the worker nodes. The pilots are designed to deal with different runtime conditions and failure scenarios, and support many storage systems. This talk will give a brief overview of the PanDA pilot system and will present major features and recent improvements including CernVM File System integration, the job retry mechanism, advanced job monitoring including JEM technology, and validation of new pilot code using the HammerCloud stress-testing system. PanDA is used for all ATLAS distributed production and is the primary system for distributed analysis. It is currently used at over 100 sites world-wide. We analyze the performance of the pilot system in processing LHC data on the OSG, EGI and Nordugrid infrastructures used by ATLAS, and describe plans for its further evolution. |
id | cern-1450074 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2012 |
record_format | invenio |
spelling | cern-14500742019-09-30T06:29:59Zdoi:10.1088/1742-6596/396/3/032080http://cds.cern.ch/record/1450074engNilsson, PCaballero Bejar, JContreras, CCompostella, GDe, KPotekhin, MDos Santos, TMaeno, TWenaus, TRecent Improvements in the ATLAS PanDA PilotDetectors and Experimental TechniquesThe Production and Distributed Analysis system (PanDA) in the ATLAS experiment uses pilots to execute submitted jobs on the worker nodes. The pilots are designed to deal with different runtime conditions and failure scenarios, and support many storage systems. This talk will give a brief overview of the PanDA pilot system and will present major features and recent improvements including CernVM File System integration, the job retry mechanism, advanced job monitoring including JEM technology, and validation of new pilot code using the HammerCloud stress-testing system. PanDA is used for all ATLAS distributed production and is the primary system for distributed analysis. It is currently used at over 100 sites world-wide. We analyze the performance of the pilot system in processing LHC data on the OSG, EGI and Nordugrid infrastructures used by ATLAS, and describe plans for its further evolution.ATL-SOFT-PROC-2012-041oai:cds.cern.ch:14500742012-05-20 |
spellingShingle | Detectors and Experimental Techniques Nilsson, P Caballero Bejar, J Contreras, C Compostella, G De, K Potekhin, M Dos Santos, T Maeno, T Wenaus, T Recent Improvements in the ATLAS PanDA Pilot |
title | Recent Improvements in the ATLAS PanDA Pilot |
title_full | Recent Improvements in the ATLAS PanDA Pilot |
title_fullStr | Recent Improvements in the ATLAS PanDA Pilot |
title_full_unstemmed | Recent Improvements in the ATLAS PanDA Pilot |
title_short | Recent Improvements in the ATLAS PanDA Pilot |
title_sort | recent improvements in the atlas panda pilot |
topic | Detectors and Experimental Techniques |
url | https://dx.doi.org/10.1088/1742-6596/396/3/032080 http://cds.cern.ch/record/1450074 |
work_keys_str_mv | AT nilssonp recentimprovementsintheatlaspandapilot AT caballerobejarj recentimprovementsintheatlaspandapilot AT contrerasc recentimprovementsintheatlaspandapilot AT compostellag recentimprovementsintheatlaspandapilot AT dek recentimprovementsintheatlaspandapilot AT potekhinm recentimprovementsintheatlaspandapilot AT dossantost recentimprovementsintheatlaspandapilot AT maenot recentimprovementsintheatlaspandapilot AT wenaust recentimprovementsintheatlaspandapilot |