Cargando…
Evolution of the ATLAS PanDA Production and Distributed Analysis System
The PanDA (Production and Distributed Analysis) system has been developed to meet ATLAS production and analysis requirements for a data-driven workload management system capable of operating at LHC data processing scale. PanDA has performed well with high reliability and robustness during the two ye...
Autor principal: | |
---|---|
Lenguaje: | eng |
Publicado: |
2012
|
Materias: | |
Acceso en línea: | http://cds.cern.ch/record/1446204 |
_version_ | 1780924781996015616 |
---|---|
author | Maeno, T |
author_facet | Maeno, T |
author_sort | Maeno, T |
collection | CERN |
description | The PanDA (Production and Distributed Analysis) system has been developed to meet ATLAS production and analysis requirements for a data-driven workload management system capable of operating at LHC data processing scale. PanDA has performed well with high reliability and robustness during the two years of LHC data-taking, while being actively evolved to meet the rapidly changing requirements for analysis use cases. We will present an overview of system evolution including automatic rebrokerage and reattempt for analysis jobs, adaptation for the CernVM File System, support for the multi-cloud model through which Tier-2 sites act as members of multiple clouds, pledged resource management and preferential brokerage, and monitoring improvements. We will also describe results from the analysis of two years of PanDA usage statistics, current issues, and plans for the future. |
id | cern-1446204 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2012 |
record_format | invenio |
spelling | cern-14462042019-09-30T06:29:59Zhttp://cds.cern.ch/record/1446204engMaeno, TEvolution of the ATLAS PanDA Production and Distributed Analysis SystemDetectors and Experimental TechniquesThe PanDA (Production and Distributed Analysis) system has been developed to meet ATLAS production and analysis requirements for a data-driven workload management system capable of operating at LHC data processing scale. PanDA has performed well with high reliability and robustness during the two years of LHC data-taking, while being actively evolved to meet the rapidly changing requirements for analysis use cases. We will present an overview of system evolution including automatic rebrokerage and reattempt for analysis jobs, adaptation for the CernVM File System, support for the multi-cloud model through which Tier-2 sites act as members of multiple clouds, pledged resource management and preferential brokerage, and monitoring improvements. We will also describe results from the analysis of two years of PanDA usage statistics, current issues, and plans for the future.ATL-SOFT-SLIDE-2012-173oai:cds.cern.ch:14462042012-05-06 |
spellingShingle | Detectors and Experimental Techniques Maeno, T Evolution of the ATLAS PanDA Production and Distributed Analysis System |
title | Evolution of the ATLAS PanDA Production and Distributed Analysis System |
title_full | Evolution of the ATLAS PanDA Production and Distributed Analysis System |
title_fullStr | Evolution of the ATLAS PanDA Production and Distributed Analysis System |
title_full_unstemmed | Evolution of the ATLAS PanDA Production and Distributed Analysis System |
title_short | Evolution of the ATLAS PanDA Production and Distributed Analysis System |
title_sort | evolution of the atlas panda production and distributed analysis system |
topic | Detectors and Experimental Techniques |
url | http://cds.cern.ch/record/1446204 |
work_keys_str_mv | AT maenot evolutionoftheatlaspandaproductionanddistributedanalysissystem |