Cargando…
PROOF-based analysis on the ATLAS Grid facilities: first experience with the PoD/PanDa plugin
In the ATLAS computing model Grid resources are managed by the PanDA system, a data-driven workload management system designed for production and distributed analysis. Data are stored under various formats in ROOT files and end-user physicists have the choice to use either the ATHENA framework or di...
Autores principales: | , , , , , , , , , , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2013
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1088/1742-6596/513/3/032102 http://cds.cern.ch/record/1621971 |
_version_ | 1780933218296397824 |
---|---|
author | Vilucchi, E De Salvo, A Di Donato, C Di Nardo, R Doria, A Ganis, G Manafov, A Mancini, G Mazza, S Preltz, F Rebatto, D Salvucci, A Pineda, A S |
author_facet | Vilucchi, E De Salvo, A Di Donato, C Di Nardo, R Doria, A Ganis, G Manafov, A Mancini, G Mazza, S Preltz, F Rebatto, D Salvucci, A Pineda, A S |
author_sort | Vilucchi, E |
collection | CERN |
description | In the ATLAS computing model Grid resources are managed by the PanDA system, a data-driven workload management system designed for production and distributed analysis. Data are stored under various formats in ROOT files and end-user physicists have the choice to use either the ATHENA framework or directly ROOT. The ROOT way to analyze data provides users the possibility to use PROOF to exploit the computing power of multi-core machines or to dynamically manage analysis facilities. Since analysis facilities are, in general, not dedicated to PROOF only, PROOF-on-Demand (PoD) is used to enable PROOF on top of an existing resource management system.\nIn a previous work we investigated the usage of PoD to enable PROOF-based analysis on Tier-2 facilities using the PoD/gLite plug-in interface. Our study focused in particular on the startup time and on the aggregate read-out rate, showing promising results for both cases.\nIn this paper we present the status of our investigations using the recently developed PoD/PanDA plug-in to enable PROOF, and a real end-user ATLAS physics analysis as payload. For this work, data were accessed using two different protocols: XRootD and file protocol, the former in the site where the SRM interface is Disk Pool Manager (DPM) and the latter where the SRM interface is StoRM with GPFS file system. \nThe results of some benchmark tests we run on the Italian Tier-2 sites and at CERN. Then, we compare the results of different types of analysis, comparing performances accessing data in relation to different types of SRM interfaces and accessing data with XRootD in the LAN and in the WAN using the ATLAS storage federation infrastructure. |
id | cern-1621971 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2013 |
record_format | invenio |
spelling | cern-16219712019-09-30T06:29:59Zdoi:10.1088/1742-6596/513/3/032102http://cds.cern.ch/record/1621971engVilucchi, EDe Salvo, ADi Donato, CDi Nardo, RDoria, AGanis, GManafov, AMancini, GMazza, SPreltz, FRebatto, DSalvucci, APineda, A SPROOF-based analysis on the ATLAS Grid facilities: first experience with the PoD/PanDa pluginDetectors and Experimental TechniquesIn the ATLAS computing model Grid resources are managed by the PanDA system, a data-driven workload management system designed for production and distributed analysis. Data are stored under various formats in ROOT files and end-user physicists have the choice to use either the ATHENA framework or directly ROOT. The ROOT way to analyze data provides users the possibility to use PROOF to exploit the computing power of multi-core machines or to dynamically manage analysis facilities. Since analysis facilities are, in general, not dedicated to PROOF only, PROOF-on-Demand (PoD) is used to enable PROOF on top of an existing resource management system.\nIn a previous work we investigated the usage of PoD to enable PROOF-based analysis on Tier-2 facilities using the PoD/gLite plug-in interface. Our study focused in particular on the startup time and on the aggregate read-out rate, showing promising results for both cases.\nIn this paper we present the status of our investigations using the recently developed PoD/PanDA plug-in to enable PROOF, and a real end-user ATLAS physics analysis as payload. For this work, data were accessed using two different protocols: XRootD and file protocol, the former in the site where the SRM interface is Disk Pool Manager (DPM) and the latter where the SRM interface is StoRM with GPFS file system. \nThe results of some benchmark tests we run on the Italian Tier-2 sites and at CERN. Then, we compare the results of different types of analysis, comparing performances accessing data in relation to different types of SRM interfaces and accessing data with XRootD in the LAN and in the WAN using the ATLAS storage federation infrastructure.ATL-SOFT-PROC-2013-036oai:cds.cern.ch:16219712013-10-29 |
spellingShingle | Detectors and Experimental Techniques Vilucchi, E De Salvo, A Di Donato, C Di Nardo, R Doria, A Ganis, G Manafov, A Mancini, G Mazza, S Preltz, F Rebatto, D Salvucci, A Pineda, A S PROOF-based analysis on the ATLAS Grid facilities: first experience with the PoD/PanDa plugin |
title | PROOF-based analysis on the ATLAS Grid facilities: first experience with the PoD/PanDa plugin |
title_full | PROOF-based analysis on the ATLAS Grid facilities: first experience with the PoD/PanDa plugin |
title_fullStr | PROOF-based analysis on the ATLAS Grid facilities: first experience with the PoD/PanDa plugin |
title_full_unstemmed | PROOF-based analysis on the ATLAS Grid facilities: first experience with the PoD/PanDa plugin |
title_short | PROOF-based analysis on the ATLAS Grid facilities: first experience with the PoD/PanDa plugin |
title_sort | proof-based analysis on the atlas grid facilities: first experience with the pod/panda plugin |
topic | Detectors and Experimental Techniques |
url | https://dx.doi.org/10.1088/1742-6596/513/3/032102 http://cds.cern.ch/record/1621971 |
work_keys_str_mv | AT vilucchie proofbasedanalysisontheatlasgridfacilitiesfirstexperiencewiththepodpandaplugin AT desalvoa proofbasedanalysisontheatlasgridfacilitiesfirstexperiencewiththepodpandaplugin AT didonatoc proofbasedanalysisontheatlasgridfacilitiesfirstexperiencewiththepodpandaplugin AT dinardor proofbasedanalysisontheatlasgridfacilitiesfirstexperiencewiththepodpandaplugin AT doriaa proofbasedanalysisontheatlasgridfacilitiesfirstexperiencewiththepodpandaplugin AT ganisg proofbasedanalysisontheatlasgridfacilitiesfirstexperiencewiththepodpandaplugin AT manafova proofbasedanalysisontheatlasgridfacilitiesfirstexperiencewiththepodpandaplugin AT mancinig proofbasedanalysisontheatlasgridfacilitiesfirstexperiencewiththepodpandaplugin AT mazzas proofbasedanalysisontheatlasgridfacilitiesfirstexperiencewiththepodpandaplugin AT preltzf proofbasedanalysisontheatlasgridfacilitiesfirstexperiencewiththepodpandaplugin AT rebattod proofbasedanalysisontheatlasgridfacilitiesfirstexperiencewiththepodpandaplugin AT salvuccia proofbasedanalysisontheatlasgridfacilitiesfirstexperiencewiththepodpandaplugin AT pinedaas proofbasedanalysisontheatlasgridfacilitiesfirstexperiencewiththepodpandaplugin |