Cargando…

The ATLAS PanDA Pilot in Operation

The ATLAS Production and Distributed Analysis system (PanDA) was designed to meet ATLAS requirements for a data-driven workload management system capable of operating at LHC data processing scale. Submitted jobs are executed on worker nodes by pilot jobs sent to the grid sites by pilot factories. Th...

Descripción completa

Detalles Bibliográficos
Autor principal: Nilsson, P
Lenguaje:eng
Publicado: 2010
Materias:
Acceso en línea:http://cds.cern.ch/record/1298833
_version_ 1780921001604808704
author Nilsson, P
author_facet Nilsson, P
author_sort Nilsson, P
collection CERN
description The ATLAS Production and Distributed Analysis system (PanDA) was designed to meet ATLAS requirements for a data-driven workload management system capable of operating at LHC data processing scale. Submitted jobs are executed on worker nodes by pilot jobs sent to the grid sites by pilot factories. This poster provides an overview of the PanDA pilot system and presents major features added in light of recent operational experience, including multi-job processing, advanced job recovery for jobs with output storage failures, gLExec based identity switching from the generic pilot to the actual user, and other security measures. The PanDA system serves all ATLAS distributed processing and is the primary system for distributed analysis; it is currently used at over 100 sites world-wide. We analyze the performance of the pilot system in processing real LHC data on the OSG, EGI and Nordugrid infrastructures used by ATLAS, and describe plans for its evolution.
id cern-1298833
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2010
record_format invenio
spelling cern-12988332019-09-30T06:29:59Zhttp://cds.cern.ch/record/1298833engNilsson, PThe ATLAS PanDA Pilot in OperationDetectors and Experimental TechniquesThe ATLAS Production and Distributed Analysis system (PanDA) was designed to meet ATLAS requirements for a data-driven workload management system capable of operating at LHC data processing scale. Submitted jobs are executed on worker nodes by pilot jobs sent to the grid sites by pilot factories. This poster provides an overview of the PanDA pilot system and presents major features added in light of recent operational experience, including multi-job processing, advanced job recovery for jobs with output storage failures, gLExec based identity switching from the generic pilot to the actual user, and other security measures. The PanDA system serves all ATLAS distributed processing and is the primary system for distributed analysis; it is currently used at over 100 sites world-wide. We analyze the performance of the pilot system in processing real LHC data on the OSG, EGI and Nordugrid infrastructures used by ATLAS, and describe plans for its evolution.ATL-SOFT-SLIDE-2010-362oai:cds.cern.ch:12988332010-10-11
spellingShingle Detectors and Experimental Techniques
Nilsson, P
The ATLAS PanDA Pilot in Operation
title The ATLAS PanDA Pilot in Operation
title_full The ATLAS PanDA Pilot in Operation
title_fullStr The ATLAS PanDA Pilot in Operation
title_full_unstemmed The ATLAS PanDA Pilot in Operation
title_short The ATLAS PanDA Pilot in Operation
title_sort atlas panda pilot in operation
topic Detectors and Experimental Techniques
url http://cds.cern.ch/record/1298833
work_keys_str_mv AT nilssonp theatlaspandapilotinoperation
AT nilssonp atlaspandapilotinoperation