Cargando…
Direct data access protocols benchmarking on DPM
The Disk Pool Manager is an example of a multi-protocol, multi-VO system for data access on the Grid that went though a considerable technical evolution in the last years. Among other features, its architecture offers the opportunity of testing its different data access frontends under exactly the s...
Autores principales: | , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2015
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1088/1742-6596/664/4/042018 http://cds.cern.ch/record/2134562 |
_version_ | 1780949905133535232 |
---|---|
author | Furano, Fabrizio Devresse, Adrien Keeble, Oliver Mancinelli, Valentina |
author_facet | Furano, Fabrizio Devresse, Adrien Keeble, Oliver Mancinelli, Valentina |
author_sort | Furano, Fabrizio |
collection | CERN |
description | The Disk Pool Manager is an example of a multi-protocol, multi-VO system for data access on the Grid that went though a considerable technical evolution in the last years. Among other features, its architecture offers the opportunity of testing its different data access frontends under exactly the same conditions, including hardware and backend software. This characteristic inspired the idea of collecting monitoring information from various testbeds in order to benchmark the behaviour of the HTTP and Xrootd protocols for the use case of data analysis, batch or interactive. A source of information is the set of continuous tests that are run towards the worldwide endpoints belonging to the DPM Collaboration, which accumulated relevant statistics in its first year of activity. On top of that, the DPM releases are based on multiple levels of automated testing that include performance benchmarks of various kinds, executed regularly every day. At the same time, the recent releases of DPM can report monitoring information about any data access protocol to the same monitoring infrastructure that is used to monitor the Xrootd deployments. Our goal is to evaluate under which circumstances the HTTP-based protocols can be good enough for batch or interactive data access. In this contribution we show and discuss the results that our test systems have collected under the circumstances that include ROOT analyses using TTreeCache and stress tests on the metadata performance. |
id | oai-inspirehep.net-1413850 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2015 |
record_format | invenio |
spelling | oai-inspirehep.net-14138502022-08-10T13:00:52Zdoi:10.1088/1742-6596/664/4/042018http://cds.cern.ch/record/2134562engFurano, FabrizioDevresse, AdrienKeeble, OliverMancinelli, ValentinaDirect data access protocols benchmarking on DPMComputing and ComputersThe Disk Pool Manager is an example of a multi-protocol, multi-VO system for data access on the Grid that went though a considerable technical evolution in the last years. Among other features, its architecture offers the opportunity of testing its different data access frontends under exactly the same conditions, including hardware and backend software. This characteristic inspired the idea of collecting monitoring information from various testbeds in order to benchmark the behaviour of the HTTP and Xrootd protocols for the use case of data analysis, batch or interactive. A source of information is the set of continuous tests that are run towards the worldwide endpoints belonging to the DPM Collaboration, which accumulated relevant statistics in its first year of activity. On top of that, the DPM releases are based on multiple levels of automated testing that include performance benchmarks of various kinds, executed regularly every day. At the same time, the recent releases of DPM can report monitoring information about any data access protocol to the same monitoring infrastructure that is used to monitor the Xrootd deployments. Our goal is to evaluate under which circumstances the HTTP-based protocols can be good enough for batch or interactive data access. In this contribution we show and discuss the results that our test systems have collected under the circumstances that include ROOT analyses using TTreeCache and stress tests on the metadata performance.oai:inspirehep.net:14138502015 |
spellingShingle | Computing and Computers Furano, Fabrizio Devresse, Adrien Keeble, Oliver Mancinelli, Valentina Direct data access protocols benchmarking on DPM |
title | Direct data access protocols benchmarking on DPM |
title_full | Direct data access protocols benchmarking on DPM |
title_fullStr | Direct data access protocols benchmarking on DPM |
title_full_unstemmed | Direct data access protocols benchmarking on DPM |
title_short | Direct data access protocols benchmarking on DPM |
title_sort | direct data access protocols benchmarking on dpm |
topic | Computing and Computers |
url | https://dx.doi.org/10.1088/1742-6596/664/4/042018 http://cds.cern.ch/record/2134562 |
work_keys_str_mv | AT furanofabrizio directdataaccessprotocolsbenchmarkingondpm AT devresseadrien directdataaccessprotocolsbenchmarkingondpm AT keebleoliver directdataaccessprotocolsbenchmarkingondpm AT mancinellivalentina directdataaccessprotocolsbenchmarkingondpm |