Cargando…

Disk storage at CERN: Handling LHC data and beyond

The CERN-IT Data Storage and Services (DSS) group stores and provides access to data coming from the LHC and other physics experiments. We implement specialised storage services to provide tools for optimal data management, based on the evolution of data volumes, the available technologies and the o...

Descripción completa

Detalles Bibliográficos
Autores principales: Espinal, Xavier, Adde, G, Chan, B, Iven, J, Lo Presti, G, Lamanna, M, Mascetti, L, Pace, A, Peters, A, Ponce, S, Sindrilaru, E
Lenguaje:eng
Publicado: 2014
Materias:
Acceso en línea:https://dx.doi.org/10.1088/1742-6596/513/4/042017
http://cds.cern.ch/record/2026331
_version_ 1780947349339635712
author Espinal, Xavier
Adde, G
Chan, B
Iven, J
Lo Presti, G
Lamanna, M
Mascetti, L
Pace, A
Peters, A
Ponce, S
Sindrilaru, E
author_facet Espinal, Xavier
Adde, G
Chan, B
Iven, J
Lo Presti, G
Lamanna, M
Mascetti, L
Pace, A
Peters, A
Ponce, S
Sindrilaru, E
author_sort Espinal, Xavier
collection CERN
description The CERN-IT Data Storage and Services (DSS) group stores and provides access to data coming from the LHC and other physics experiments. We implement specialised storage services to provide tools for optimal data management, based on the evolution of data volumes, the available technologies and the observed experiment and users' usage patterns. Our current solutions are CASTOR, for highly-reliable tape-backed storage for heavy-duty Tier-0 workflows, and EOS, for disk-only storage for full-scale analysis activities. CASTOR is evolving towards a simplified disk layer in front of the tape robotics, focusing on recording the primary data from the detectors. EOS is now a well-established storage service used intensively by the four big LHC experiments. Its conceptual design based on multi-replica and in-memory namespace, makes it the perfect system for data intensive workflows. The LHC-Long Shutdown 1 (LSI) presents a window of opportunity to shape up both of our storage services and validate against the ongoing analysis activity in order to successfully face the new LHC data taking period in 2015. In this paper, the current state and foreseen evolutions of CASTOR and EOS will be presented together with a study about the reliability of our systems.
id oai-inspirehep.net-1302092
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2014
record_format invenio
spelling oai-inspirehep.net-13020922022-08-17T13:29:08Zdoi:10.1088/1742-6596/513/4/042017http://cds.cern.ch/record/2026331engEspinal, XavierAdde, GChan, BIven, JLo Presti, GLamanna, MMascetti, LPace, APeters, APonce, SSindrilaru, EDisk storage at CERN: Handling LHC data and beyondComputing and ComputersThe CERN-IT Data Storage and Services (DSS) group stores and provides access to data coming from the LHC and other physics experiments. We implement specialised storage services to provide tools for optimal data management, based on the evolution of data volumes, the available technologies and the observed experiment and users' usage patterns. Our current solutions are CASTOR, for highly-reliable tape-backed storage for heavy-duty Tier-0 workflows, and EOS, for disk-only storage for full-scale analysis activities. CASTOR is evolving towards a simplified disk layer in front of the tape robotics, focusing on recording the primary data from the detectors. EOS is now a well-established storage service used intensively by the four big LHC experiments. Its conceptual design based on multi-replica and in-memory namespace, makes it the perfect system for data intensive workflows. The LHC-Long Shutdown 1 (LSI) presents a window of opportunity to shape up both of our storage services and validate against the ongoing analysis activity in order to successfully face the new LHC data taking period in 2015. In this paper, the current state and foreseen evolutions of CASTOR and EOS will be presented together with a study about the reliability of our systems.oai:inspirehep.net:13020922014
spellingShingle Computing and Computers
Espinal, Xavier
Adde, G
Chan, B
Iven, J
Lo Presti, G
Lamanna, M
Mascetti, L
Pace, A
Peters, A
Ponce, S
Sindrilaru, E
Disk storage at CERN: Handling LHC data and beyond
title Disk storage at CERN: Handling LHC data and beyond
title_full Disk storage at CERN: Handling LHC data and beyond
title_fullStr Disk storage at CERN: Handling LHC data and beyond
title_full_unstemmed Disk storage at CERN: Handling LHC data and beyond
title_short Disk storage at CERN: Handling LHC data and beyond
title_sort disk storage at cern: handling lhc data and beyond
topic Computing and Computers
url https://dx.doi.org/10.1088/1742-6596/513/4/042017
http://cds.cern.ch/record/2026331
work_keys_str_mv AT espinalxavier diskstorageatcernhandlinglhcdataandbeyond
AT addeg diskstorageatcernhandlinglhcdataandbeyond
AT chanb diskstorageatcernhandlinglhcdataandbeyond
AT ivenj diskstorageatcernhandlinglhcdataandbeyond
AT loprestig diskstorageatcernhandlinglhcdataandbeyond
AT lamannam diskstorageatcernhandlinglhcdataandbeyond
AT mascettil diskstorageatcernhandlinglhcdataandbeyond
AT pacea diskstorageatcernhandlinglhcdataandbeyond
AT petersa diskstorageatcernhandlinglhcdataandbeyond
AT ponces diskstorageatcernhandlinglhcdataandbeyond
AT sindrilarue diskstorageatcernhandlinglhcdataandbeyond