Cargando…

Data management in HEP: An approach

In this work we describe an approach to data access and data management in High Energy Physics (HEP), which privileges performance, simplicity and scalability, in storage systems that co-operate. We also show why the typical HEP workload is well positioned to access geographically distributed data r...

Descripción completa

Detalles Bibliográficos
Autor principal: Furano, F
Lenguaje:eng
Publicado: 2011
Materias:
Acceso en línea:https://dx.doi.org/10.1140/epjp/i2011-11012-2
http://cds.cern.ch/record/1399896
_version_ 1780923645465460736
author Furano, F
author_facet Furano, F
author_sort Furano, F
collection CERN
description In this work we describe an approach to data access and data management in High Energy Physics (HEP), which privileges performance, simplicity and scalability, in storage systems that co-operate. We also show why the typical HEP workload is well positioned to access geographically distributed data repositories and then weigh the advantages and disadvantages of accessing data across the Wide Area Network. We discuss some points related to the architecture that a data access/management system should have in order to exploit these possibilities. Currently, this kind of methods were explored by using the xrootd/Scalla software suite, that is a workable example of a distributed non-transactional data repository for the HEP environment. The Scalla architecture naturally allows us to build globally federated repositories congruent with diverse HEP collaborations and their data access needs. These methodologies, however, are based on the concept of caching associated to a performant messaging system and to an efficient way of accessing data through Wide Area Network, thus they can be applied to other data access systems as well.
id cern-1399896
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2011
record_format invenio
spelling cern-13998962019-09-30T06:29:59Zdoi:10.1140/epjp/i2011-11012-2http://cds.cern.ch/record/1399896engFurano, FData management in HEP: An approachComputing and ComputersIn this work we describe an approach to data access and data management in High Energy Physics (HEP), which privileges performance, simplicity and scalability, in storage systems that co-operate. We also show why the typical HEP workload is well positioned to access geographically distributed data repositories and then weigh the advantages and disadvantages of accessing data across the Wide Area Network. We discuss some points related to the architecture that a data access/management system should have in order to exploit these possibilities. Currently, this kind of methods were explored by using the xrootd/Scalla software suite, that is a workable example of a distributed non-transactional data repository for the HEP environment. The Scalla architecture naturally allows us to build globally federated repositories congruent with diverse HEP collaborations and their data access needs. These methodologies, however, are based on the concept of caching associated to a performant messaging system and to an efficient way of accessing data through Wide Area Network, thus they can be applied to other data access systems as well.oai:cds.cern.ch:13998962011
spellingShingle Computing and Computers
Furano, F
Data management in HEP: An approach
title Data management in HEP: An approach
title_full Data management in HEP: An approach
title_fullStr Data management in HEP: An approach
title_full_unstemmed Data management in HEP: An approach
title_short Data management in HEP: An approach
title_sort data management in hep: an approach
topic Computing and Computers
url https://dx.doi.org/10.1140/epjp/i2011-11012-2
http://cds.cern.ch/record/1399896
work_keys_str_mv AT furanof datamanagementinhepanapproach