Cargando…
Tests of PROOF-on-Demand with ATLAS Prodsys2 and first experience with HTTP federation
During the LHC Run-1, Grid resources in ATLAS have been managed by the PanDA and DQ2 systems. In order to meet the needs for the LHC Run-2, Prodsys2 and Rucio are used as the new ATLAS Workload and Data Management systems. The data are stored under various formats in ROOT files and end-user physicis...
Autores principales: | , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2015
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1088/1742-6596/664/4/042019 http://cds.cern.ch/record/2016635 |
_version_ | 1780946702885191680 |
---|---|
author | Di Nardo, Roberto Ganis, Gerardo Vilucchi, Elisabetta Antonelli, Mario |
author_facet | Di Nardo, Roberto Ganis, Gerardo Vilucchi, Elisabetta Antonelli, Mario |
author_sort | Di Nardo, Roberto |
collection | CERN |
description | During the LHC Run-1, Grid resources in ATLAS have been managed by the PanDA and DQ2 systems. In order to meet the needs for the LHC Run-2, Prodsys2 and Rucio are used as the new ATLAS Workload and Data Management systems. The data are stored under various formats in ROOT files and end-user physicists have the choice to use either the ATHENA framework or directly ROOT. Within the ROOT data analysis framework it is possible to perform analysis of huge sets of ROOT files in parallel with PROOF on clusters of computers (usually organised in analysis facilities) or multi-core machines. In addition, PROOF-on-Demand (PoD) can be used to enable PROOF on top of an existing resource management system. In this work, we present the first performances obtained enabling PROOF-based analysis at CERN and in some of the Italian ATLAS Tier-2 sites within the new ATLAS workload system. Benchmark tests of data access with the httpd protocol, using also the httpd redirector, will be shown. We also present results on the startup latency tests using the new PROOF functionality of dynamic workers addition, which improves the performance of PoD using Grid resources. These new results will be compared with the expected improvements discussed in a previous work. |
id | cern-2016635 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2015 |
record_format | invenio |
spelling | cern-20166352022-08-10T12:53:04Zdoi:10.1088/1742-6596/664/4/042019http://cds.cern.ch/record/2016635engDi Nardo, RobertoGanis, GerardoVilucchi, ElisabettaAntonelli, MarioTests of PROOF-on-Demand with ATLAS Prodsys2 and first experience with HTTP federationParticle Physics - ExperimentDuring the LHC Run-1, Grid resources in ATLAS have been managed by the PanDA and DQ2 systems. In order to meet the needs for the LHC Run-2, Prodsys2 and Rucio are used as the new ATLAS Workload and Data Management systems. The data are stored under various formats in ROOT files and end-user physicists have the choice to use either the ATHENA framework or directly ROOT. Within the ROOT data analysis framework it is possible to perform analysis of huge sets of ROOT files in parallel with PROOF on clusters of computers (usually organised in analysis facilities) or multi-core machines. In addition, PROOF-on-Demand (PoD) can be used to enable PROOF on top of an existing resource management system. In this work, we present the first performances obtained enabling PROOF-based analysis at CERN and in some of the Italian ATLAS Tier-2 sites within the new ATLAS workload system. Benchmark tests of data access with the httpd protocol, using also the httpd redirector, will be shown. We also present results on the startup latency tests using the new PROOF functionality of dynamic workers addition, which improves the performance of PoD using Grid resources. These new results will be compared with the expected improvements discussed in a previous work.ATL-SOFT-PROC-2015-043oai:cds.cern.ch:20166352015-05-17 |
spellingShingle | Particle Physics - Experiment Di Nardo, Roberto Ganis, Gerardo Vilucchi, Elisabetta Antonelli, Mario Tests of PROOF-on-Demand with ATLAS Prodsys2 and first experience with HTTP federation |
title | Tests of PROOF-on-Demand with ATLAS Prodsys2 and first experience with HTTP federation |
title_full | Tests of PROOF-on-Demand with ATLAS Prodsys2 and first experience with HTTP federation |
title_fullStr | Tests of PROOF-on-Demand with ATLAS Prodsys2 and first experience with HTTP federation |
title_full_unstemmed | Tests of PROOF-on-Demand with ATLAS Prodsys2 and first experience with HTTP federation |
title_short | Tests of PROOF-on-Demand with ATLAS Prodsys2 and first experience with HTTP federation |
title_sort | tests of proof-on-demand with atlas prodsys2 and first experience with http federation |
topic | Particle Physics - Experiment |
url | https://dx.doi.org/10.1088/1742-6596/664/4/042019 http://cds.cern.ch/record/2016635 |
work_keys_str_mv | AT dinardoroberto testsofproofondemandwithatlasprodsys2andfirstexperiencewithhttpfederation AT ganisgerardo testsofproofondemandwithatlasprodsys2andfirstexperiencewithhttpfederation AT vilucchielisabetta testsofproofondemandwithatlasprodsys2andfirstexperiencewithhttpfederation AT antonellimario testsofproofondemandwithatlasprodsys2andfirstexperiencewithhttpfederation |