Cargando…

Direct data access protocols benchmarking on DPM

The Disk Pool Manager is an example of a multi-protocol, multi-VO system for data access on the Grid that went though a considerable technical evolution in the last years. Among other features, its architecture offers the opportunity of testing its different data access frontends under exactly the s...

Descripción completa

Detalles Bibliográficos
Autores principales: Furano, Fabrizio, Devresse, Adrien, Keeble, Oliver, Mancinelli, Valentina
Lenguaje:eng
Publicado: 2015
Materias:
Acceso en línea:https://dx.doi.org/10.1088/1742-6596/664/4/042018
http://cds.cern.ch/record/2134562
_version_ 1780949905133535232
author Furano, Fabrizio
Devresse, Adrien
Keeble, Oliver
Mancinelli, Valentina
author_facet Furano, Fabrizio
Devresse, Adrien
Keeble, Oliver
Mancinelli, Valentina
author_sort Furano, Fabrizio
collection CERN
description The Disk Pool Manager is an example of a multi-protocol, multi-VO system for data access on the Grid that went though a considerable technical evolution in the last years. Among other features, its architecture offers the opportunity of testing its different data access frontends under exactly the same conditions, including hardware and backend software. This characteristic inspired the idea of collecting monitoring information from various testbeds in order to benchmark the behaviour of the HTTP and Xrootd protocols for the use case of data analysis, batch or interactive. A source of information is the set of continuous tests that are run towards the worldwide endpoints belonging to the DPM Collaboration, which accumulated relevant statistics in its first year of activity. On top of that, the DPM releases are based on multiple levels of automated testing that include performance benchmarks of various kinds, executed regularly every day. At the same time, the recent releases of DPM can report monitoring information about any data access protocol to the same monitoring infrastructure that is used to monitor the Xrootd deployments. Our goal is to evaluate under which circumstances the HTTP-based protocols can be good enough for batch or interactive data access. In this contribution we show and discuss the results that our test systems have collected under the circumstances that include ROOT analyses using TTreeCache and stress tests on the metadata performance.
id oai-inspirehep.net-1413850
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2015
record_format invenio
spelling oai-inspirehep.net-14138502022-08-10T13:00:52Zdoi:10.1088/1742-6596/664/4/042018http://cds.cern.ch/record/2134562engFurano, FabrizioDevresse, AdrienKeeble, OliverMancinelli, ValentinaDirect data access protocols benchmarking on DPMComputing and ComputersThe Disk Pool Manager is an example of a multi-protocol, multi-VO system for data access on the Grid that went though a considerable technical evolution in the last years. Among other features, its architecture offers the opportunity of testing its different data access frontends under exactly the same conditions, including hardware and backend software. This characteristic inspired the idea of collecting monitoring information from various testbeds in order to benchmark the behaviour of the HTTP and Xrootd protocols for the use case of data analysis, batch or interactive. A source of information is the set of continuous tests that are run towards the worldwide endpoints belonging to the DPM Collaboration, which accumulated relevant statistics in its first year of activity. On top of that, the DPM releases are based on multiple levels of automated testing that include performance benchmarks of various kinds, executed regularly every day. At the same time, the recent releases of DPM can report monitoring information about any data access protocol to the same monitoring infrastructure that is used to monitor the Xrootd deployments. Our goal is to evaluate under which circumstances the HTTP-based protocols can be good enough for batch or interactive data access. In this contribution we show and discuss the results that our test systems have collected under the circumstances that include ROOT analyses using TTreeCache and stress tests on the metadata performance.oai:inspirehep.net:14138502015
spellingShingle Computing and Computers
Furano, Fabrizio
Devresse, Adrien
Keeble, Oliver
Mancinelli, Valentina
Direct data access protocols benchmarking on DPM
title Direct data access protocols benchmarking on DPM
title_full Direct data access protocols benchmarking on DPM
title_fullStr Direct data access protocols benchmarking on DPM
title_full_unstemmed Direct data access protocols benchmarking on DPM
title_short Direct data access protocols benchmarking on DPM
title_sort direct data access protocols benchmarking on dpm
topic Computing and Computers
url https://dx.doi.org/10.1088/1742-6596/664/4/042018
http://cds.cern.ch/record/2134562
work_keys_str_mv AT furanofabrizio directdataaccessprotocolsbenchmarkingondpm
AT devresseadrien directdataaccessprotocolsbenchmarkingondpm
AT keebleoliver directdataaccessprotocolsbenchmarkingondpm
AT mancinellivalentina directdataaccessprotocolsbenchmarkingondpm