Cargando…
Evaluation of benefits of a three tier data model for WLCG analysis
<!--HTML-->One of the most crucial requirement for online storage is the fast and efficient access to data. Although smart client side caching often compensates for discomforts like latencies and server disk congestion, spinning disks, with their limited ability to serve multi stream random a...
Autores principales: | , |
---|---|
Lenguaje: | eng |
Publicado: |
2012
|
Materias: | |
Acceso en línea: | http://cds.cern.ch/record/1460680 |
_version_ | 1780925254016696320 |
---|---|
author | Fuhrmann, Patrick Ozerov, Dmitry |
author_facet | Fuhrmann, Patrick Ozerov, Dmitry |
author_sort | Fuhrmann, Patrick |
collection | CERN |
description | <!--HTML-->One of the most crucial requirement for online storage is the fast and efficient access to data.
Although smart client side caching often compensates for discomforts like latencies and server disk congestion, spinning disks, with their limited ability to serve multi stream random access patterns, seem to be the cause of most of the observed inefficiencies.
With the appearance of the different variants of solid state disks (SSD), this deficiency could be overcome, however, replacing the entire experiment data repositories by SSDs is not feasible in the foreseeable future.
Moreover, spinning disks are still appropriate media for controlled streaming applications.
Assuming a deployment of a mixture of media, like spinning disks, SSDs and tape, at a site, the authors argue for the introduction of a three tier media structure within a single storage system with automatic transitions, based on usage patterns, in contrast to interlinking and maintaining different mediatypes in different systems with external procedures taking care of proper data placement.
The feasibility of the suggested approach is studied, using the analysis of access logs of the DESY WLCG Tier II storage elements, hosting the largest part of the data
to be analyzed by the CMS and ATLAS Collaborations.
Finally we will report on a prototype implementing of the three tier media structure into dCache, a storage technology widely used in WLCG. |
id | cern-1460680 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2012 |
record_format | invenio |
spelling | cern-14606802022-11-02T22:23:34Zhttp://cds.cern.ch/record/1460680engFuhrmann, PatrickOzerov, DmitryEvaluation of benefits of a three tier data model for WLCG analysisComputing in High Energy and Nuclear Physics (CHEP) 2012Conferences<!--HTML-->One of the most crucial requirement for online storage is the fast and efficient access to data. Although smart client side caching often compensates for discomforts like latencies and server disk congestion, spinning disks, with their limited ability to serve multi stream random access patterns, seem to be the cause of most of the observed inefficiencies. With the appearance of the different variants of solid state disks (SSD), this deficiency could be overcome, however, replacing the entire experiment data repositories by SSDs is not feasible in the foreseeable future. Moreover, spinning disks are still appropriate media for controlled streaming applications. Assuming a deployment of a mixture of media, like spinning disks, SSDs and tape, at a site, the authors argue for the introduction of a three tier media structure within a single storage system with automatic transitions, based on usage patterns, in contrast to interlinking and maintaining different mediatypes in different systems with external procedures taking care of proper data placement. The feasibility of the suggested approach is studied, using the analysis of access logs of the DESY WLCG Tier II storage elements, hosting the largest part of the data to be analyzed by the CMS and ATLAS Collaborations. Finally we will report on a prototype implementing of the three tier media structure into dCache, a storage technology widely used in WLCG.oai:cds.cern.ch:14606802012 |
spellingShingle | Conferences Fuhrmann, Patrick Ozerov, Dmitry Evaluation of benefits of a three tier data model for WLCG analysis |
title | Evaluation of benefits of a three tier data model for WLCG analysis |
title_full | Evaluation of benefits of a three tier data model for WLCG analysis |
title_fullStr | Evaluation of benefits of a three tier data model for WLCG analysis |
title_full_unstemmed | Evaluation of benefits of a three tier data model for WLCG analysis |
title_short | Evaluation of benefits of a three tier data model for WLCG analysis |
title_sort | evaluation of benefits of a three tier data model for wlcg analysis |
topic | Conferences |
url | http://cds.cern.ch/record/1460680 |
work_keys_str_mv | AT fuhrmannpatrick evaluationofbenefitsofathreetierdatamodelforwlcganalysis AT ozerovdmitry evaluationofbenefitsofathreetierdatamodelforwlcganalysis AT fuhrmannpatrick computinginhighenergyandnuclearphysicschep2012 AT ozerovdmitry computinginhighenergyandnuclearphysicschep2012 |