Cargando…

Storage Management and Access in WLHC Computing Grid

One of the big challenges in Grid computing is storage management and access. Several solutions exist to store data in a persistent way. In this work we describe our contribution within the Worldwide LHC Computing Grid project. Substantial samples of data produced by the High Energy Physics detector...

Descripción completa

Detalles Bibliográficos
Autor principal: Donno, Flavia
Lenguaje:eng
Publicado: Pisa Univ. 2007
Materias:
Acceso en línea:http://cds.cern.ch/record/1083653
_version_ 1780913575164903424
author Donno, Flavia
author_facet Donno, Flavia
author_sort Donno, Flavia
collection CERN
description One of the big challenges in Grid computing is storage management and access. Several solutions exist to store data in a persistent way. In this work we describe our contribution within the Worldwide LHC Computing Grid project. Substantial samples of data produced by the High Energy Physics detectors at CERN are shipped for initial processing to specific large computing centers worldwide. Such centers are normally able to provide persistent storage for tens of Petabytes of data mostly on tapes. Special physics applications are used to refine and filter the data after spooling the required files from tape to disk. At smaller geographically dispersed centers, physicists perform the analysis of such data stored on disk-only caches. In this thesis we analyze the application requirements such as uniform storage management, quality of storage, POSIX-like file access, performance, etc. Furthermore, security, policy enforcement, monitoring, and accounting need to be addressed carefully in a Grid environment. We then make a survey of the multitude of storage products deployed in the WLCG infrastructure, both hardware and software. We outline the specific features, functionalities and diverse interfaces offered to users. Among the other storage services, we describe StoRM, a storage resource manager that we have designed and developed to provide an answer to specific user request for a fast and efficient Grid interface to available paral lel file systems. We propose a model for the Storage Resource Management protocol for uniform storage management and access in the Grid. The black box testing methodology has been applied in order to verify the completeness of the specifications and validate the existent implementations. We finally describe and report on the results obtained.
id cern-1083653
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2007
publisher Pisa Univ.
record_format invenio
spelling cern-10836532019-09-30T06:29:59Zhttp://cds.cern.ch/record/1083653engDonno, FlaviaStorage Management and Access in WLHC Computing GridComputing and ComputersOne of the big challenges in Grid computing is storage management and access. Several solutions exist to store data in a persistent way. In this work we describe our contribution within the Worldwide LHC Computing Grid project. Substantial samples of data produced by the High Energy Physics detectors at CERN are shipped for initial processing to specific large computing centers worldwide. Such centers are normally able to provide persistent storage for tens of Petabytes of data mostly on tapes. Special physics applications are used to refine and filter the data after spooling the required files from tape to disk. At smaller geographically dispersed centers, physicists perform the analysis of such data stored on disk-only caches. In this thesis we analyze the application requirements such as uniform storage management, quality of storage, POSIX-like file access, performance, etc. Furthermore, security, policy enforcement, monitoring, and accounting need to be addressed carefully in a Grid environment. We then make a survey of the multitude of storage products deployed in the WLCG infrastructure, both hardware and software. We outline the specific features, functionalities and diverse interfaces offered to users. Among the other storage services, we describe StoRM, a storage resource manager that we have designed and developed to provide an answer to specific user request for a fast and efficient Grid interface to available paral lel file systems. We propose a model for the Storage Resource Management protocol for uniform storage management and access in the Grid. The black box testing methodology has been applied in order to verify the completeness of the specifications and validate the existent implementations. We finally describe and report on the results obtained.Pisa Univ.CERN-THESIS-2008-008oai:cds.cern.ch:10836532007
spellingShingle Computing and Computers
Donno, Flavia
Storage Management and Access in WLHC Computing Grid
title Storage Management and Access in WLHC Computing Grid
title_full Storage Management and Access in WLHC Computing Grid
title_fullStr Storage Management and Access in WLHC Computing Grid
title_full_unstemmed Storage Management and Access in WLHC Computing Grid
title_short Storage Management and Access in WLHC Computing Grid
title_sort storage management and access in wlhc computing grid
topic Computing and Computers
url http://cds.cern.ch/record/1083653
work_keys_str_mv AT donnoflavia storagemanagementandaccessinwlhccomputinggrid