Cargando…

Evaluation of benefits of a three tier data model for WLCG analysis

<!--HTML-->One of the most crucial requirement for online storage is the fast and efficient access to data. Although smart client side caching often compensates for discomforts like latencies and server disk congestion, spinning disks, with their limited ability to serve multi stream random a...

Descripción completa

Detalles Bibliográficos
Autores principales: Fuhrmann, Patrick, Ozerov, Dmitry
Lenguaje:eng
Publicado: 2012
Materias:
Acceso en línea:http://cds.cern.ch/record/1460680
_version_ 1780925254016696320
author Fuhrmann, Patrick
Ozerov, Dmitry
author_facet Fuhrmann, Patrick
Ozerov, Dmitry
author_sort Fuhrmann, Patrick
collection CERN
description <!--HTML-->One of the most crucial requirement for online storage is the fast and efficient access to data. Although smart client side caching often compensates for discomforts like latencies and server disk congestion, spinning disks, with their limited ability to serve multi stream random access patterns, seem to be the cause of most of the observed inefficiencies. With the appearance of the different variants of solid state disks (SSD), this deficiency could be overcome, however, replacing the entire experiment data repositories by SSDs is not feasible in the foreseeable future. Moreover, spinning disks are still appropriate media for controlled streaming applications. Assuming a deployment of a mixture of media, like spinning disks, SSDs and tape, at a site, the authors argue for the introduction of a three tier media structure within a single storage system with automatic transitions, based on usage patterns, in contrast to interlinking and maintaining different mediatypes in different systems with external procedures taking care of proper data placement. The feasibility of the suggested approach is studied, using the analysis of access logs of the DESY WLCG Tier II storage elements, hosting the largest part of the data to be analyzed by the CMS and ATLAS Collaborations. Finally we will report on a prototype implementing of the three tier media structure into dCache, a storage technology widely used in WLCG.
id cern-1460680
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2012
record_format invenio
spelling cern-14606802022-11-02T22:23:34Zhttp://cds.cern.ch/record/1460680engFuhrmann, PatrickOzerov, DmitryEvaluation of benefits of a three tier data model for WLCG analysisComputing in High Energy and Nuclear Physics (CHEP) 2012Conferences<!--HTML-->One of the most crucial requirement for online storage is the fast and efficient access to data. Although smart client side caching often compensates for discomforts like latencies and server disk congestion, spinning disks, with their limited ability to serve multi stream random access patterns, seem to be the cause of most of the observed inefficiencies. With the appearance of the different variants of solid state disks (SSD), this deficiency could be overcome, however, replacing the entire experiment data repositories by SSDs is not feasible in the foreseeable future. Moreover, spinning disks are still appropriate media for controlled streaming applications. Assuming a deployment of a mixture of media, like spinning disks, SSDs and tape, at a site, the authors argue for the introduction of a three tier media structure within a single storage system with automatic transitions, based on usage patterns, in contrast to interlinking and maintaining different mediatypes in different systems with external procedures taking care of proper data placement. The feasibility of the suggested approach is studied, using the analysis of access logs of the DESY WLCG Tier II storage elements, hosting the largest part of the data to be analyzed by the CMS and ATLAS Collaborations. Finally we will report on a prototype implementing of the three tier media structure into dCache, a storage technology widely used in WLCG.oai:cds.cern.ch:14606802012
spellingShingle Conferences
Fuhrmann, Patrick
Ozerov, Dmitry
Evaluation of benefits of a three tier data model for WLCG analysis
title Evaluation of benefits of a three tier data model for WLCG analysis
title_full Evaluation of benefits of a three tier data model for WLCG analysis
title_fullStr Evaluation of benefits of a three tier data model for WLCG analysis
title_full_unstemmed Evaluation of benefits of a three tier data model for WLCG analysis
title_short Evaluation of benefits of a three tier data model for WLCG analysis
title_sort evaluation of benefits of a three tier data model for wlcg analysis
topic Conferences
url http://cds.cern.ch/record/1460680
work_keys_str_mv AT fuhrmannpatrick evaluationofbenefitsofathreetierdatamodelforwlcganalysis
AT ozerovdmitry evaluationofbenefitsofathreetierdatamodelforwlcganalysis
AT fuhrmannpatrick computinginhighenergyandnuclearphysicschep2012
AT ozerovdmitry computinginhighenergyandnuclearphysicschep2012