Cargando…
The ATLAS PanDA Pilot in Operation
The ATLAS Production and Distributed Analysis system (PanDA) was designed to meet ATLAS requirements for a data-driven workload management system capable of operating at LHC data processing scale. Submitted jobs are executed on worker nodes by pilot jobs sent to the grid sites by pilot factories. Th...
Autor principal: | |
---|---|
Lenguaje: | eng |
Publicado: |
2010
|
Materias: | |
Acceso en línea: | http://cds.cern.ch/record/1298833 |
_version_ | 1780921001604808704 |
---|---|
author | Nilsson, P |
author_facet | Nilsson, P |
author_sort | Nilsson, P |
collection | CERN |
description | The ATLAS Production and Distributed Analysis system (PanDA) was designed to meet ATLAS requirements for a data-driven workload management system capable of operating at LHC data processing scale. Submitted jobs are executed on worker nodes by pilot jobs sent to the grid sites by pilot factories. This poster provides an overview of the PanDA pilot system and presents major features added in light of recent operational experience, including multi-job processing, advanced job recovery for jobs with output storage failures, gLExec based identity switching from the generic pilot to the actual user, and other security measures. The PanDA system serves all ATLAS distributed processing and is the primary system for distributed analysis; it is currently used at over 100 sites world-wide. We analyze the performance of the pilot system in processing real LHC data on the OSG, EGI and Nordugrid infrastructures used by ATLAS, and describe plans for its evolution. |
id | cern-1298833 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2010 |
record_format | invenio |
spelling | cern-12988332019-09-30T06:29:59Zhttp://cds.cern.ch/record/1298833engNilsson, PThe ATLAS PanDA Pilot in OperationDetectors and Experimental TechniquesThe ATLAS Production and Distributed Analysis system (PanDA) was designed to meet ATLAS requirements for a data-driven workload management system capable of operating at LHC data processing scale. Submitted jobs are executed on worker nodes by pilot jobs sent to the grid sites by pilot factories. This poster provides an overview of the PanDA pilot system and presents major features added in light of recent operational experience, including multi-job processing, advanced job recovery for jobs with output storage failures, gLExec based identity switching from the generic pilot to the actual user, and other security measures. The PanDA system serves all ATLAS distributed processing and is the primary system for distributed analysis; it is currently used at over 100 sites world-wide. We analyze the performance of the pilot system in processing real LHC data on the OSG, EGI and Nordugrid infrastructures used by ATLAS, and describe plans for its evolution.ATL-SOFT-SLIDE-2010-362oai:cds.cern.ch:12988332010-10-11 |
spellingShingle | Detectors and Experimental Techniques Nilsson, P The ATLAS PanDA Pilot in Operation |
title | The ATLAS PanDA Pilot in Operation |
title_full | The ATLAS PanDA Pilot in Operation |
title_fullStr | The ATLAS PanDA Pilot in Operation |
title_full_unstemmed | The ATLAS PanDA Pilot in Operation |
title_short | The ATLAS PanDA Pilot in Operation |
title_sort | atlas panda pilot in operation |
topic | Detectors and Experimental Techniques |
url | http://cds.cern.ch/record/1298833 |
work_keys_str_mv | AT nilssonp theatlaspandapilotinoperation AT nilssonp atlaspandapilotinoperation |