Cargando…

Tests of PROOF-on-Demand with ATLAS Prodsys2 and first experience with HTTP federation

During the LHC Run-1, Grid resources in ATLAS have been managed by the PanDA and DQ2 systems. In order to meet the needs for the LHC Run-2, Prodsys2 and Rucio are used as the new ATLAS Workload and Data Management systems. The data are stored under various formats in ROOT files and end-user physicis...

Descripción completa

Detalles Bibliográficos
Autores principales: Di Nardo, Roberto, Ganis, Gerardo, Vilucchi, Elisabetta, Antonelli, Mario
Lenguaje:eng
Publicado: 2015
Materias:
Acceso en línea:https://dx.doi.org/10.1088/1742-6596/664/4/042019
http://cds.cern.ch/record/2016635
_version_ 1780946702885191680
author Di Nardo, Roberto
Ganis, Gerardo
Vilucchi, Elisabetta
Antonelli, Mario
author_facet Di Nardo, Roberto
Ganis, Gerardo
Vilucchi, Elisabetta
Antonelli, Mario
author_sort Di Nardo, Roberto
collection CERN
description During the LHC Run-1, Grid resources in ATLAS have been managed by the PanDA and DQ2 systems. In order to meet the needs for the LHC Run-2, Prodsys2 and Rucio are used as the new ATLAS Workload and Data Management systems. The data are stored under various formats in ROOT files and end-user physicists have the choice to use either the ATHENA framework or directly ROOT. Within the ROOT data analysis framework it is possible to perform analysis of huge sets of ROOT files in parallel with PROOF on clusters of computers (usually organised in analysis facilities) or multi-core machines. In addition, PROOF-on-Demand (PoD) can be used to enable PROOF on top of an existing resource management system. In this work, we present the first performances obtained enabling PROOF-based analysis at CERN and in some of the Italian ATLAS Tier-2 sites within the new ATLAS workload system. Benchmark tests of data access with the httpd protocol, using also the httpd redirector, will be shown. We also present results on the startup latency tests using the new PROOF functionality of dynamic workers addition, which improves the performance of PoD using Grid resources. These new results will be compared with the expected improvements discussed in a previous work.
id cern-2016635
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2015
record_format invenio
spelling cern-20166352022-08-10T12:53:04Zdoi:10.1088/1742-6596/664/4/042019http://cds.cern.ch/record/2016635engDi Nardo, RobertoGanis, GerardoVilucchi, ElisabettaAntonelli, MarioTests of PROOF-on-Demand with ATLAS Prodsys2 and first experience with HTTP federationParticle Physics - ExperimentDuring the LHC Run-1, Grid resources in ATLAS have been managed by the PanDA and DQ2 systems. In order to meet the needs for the LHC Run-2, Prodsys2 and Rucio are used as the new ATLAS Workload and Data Management systems. The data are stored under various formats in ROOT files and end-user physicists have the choice to use either the ATHENA framework or directly ROOT. Within the ROOT data analysis framework it is possible to perform analysis of huge sets of ROOT files in parallel with PROOF on clusters of computers (usually organised in analysis facilities) or multi-core machines. In addition, PROOF-on-Demand (PoD) can be used to enable PROOF on top of an existing resource management system. In this work, we present the first performances obtained enabling PROOF-based analysis at CERN and in some of the Italian ATLAS Tier-2 sites within the new ATLAS workload system. Benchmark tests of data access with the httpd protocol, using also the httpd redirector, will be shown. We also present results on the startup latency tests using the new PROOF functionality of dynamic workers addition, which improves the performance of PoD using Grid resources. These new results will be compared with the expected improvements discussed in a previous work.ATL-SOFT-PROC-2015-043oai:cds.cern.ch:20166352015-05-17
spellingShingle Particle Physics - Experiment
Di Nardo, Roberto
Ganis, Gerardo
Vilucchi, Elisabetta
Antonelli, Mario
Tests of PROOF-on-Demand with ATLAS Prodsys2 and first experience with HTTP federation
title Tests of PROOF-on-Demand with ATLAS Prodsys2 and first experience with HTTP federation
title_full Tests of PROOF-on-Demand with ATLAS Prodsys2 and first experience with HTTP federation
title_fullStr Tests of PROOF-on-Demand with ATLAS Prodsys2 and first experience with HTTP federation
title_full_unstemmed Tests of PROOF-on-Demand with ATLAS Prodsys2 and first experience with HTTP federation
title_short Tests of PROOF-on-Demand with ATLAS Prodsys2 and first experience with HTTP federation
title_sort tests of proof-on-demand with atlas prodsys2 and first experience with http federation
topic Particle Physics - Experiment
url https://dx.doi.org/10.1088/1742-6596/664/4/042019
http://cds.cern.ch/record/2016635
work_keys_str_mv AT dinardoroberto testsofproofondemandwithatlasprodsys2andfirstexperiencewithhttpfederation
AT ganisgerardo testsofproofondemandwithatlasprodsys2andfirstexperiencewithhttpfederation
AT vilucchielisabetta testsofproofondemandwithatlasprodsys2andfirstexperiencewithhttpfederation
AT antonellimario testsofproofondemandwithatlasprodsys2andfirstexperiencewithhttpfederation