Cargando…
Disk storage at CERN: Handling LHC data and beyond
The CERN-IT Data Storage and Services (DSS) group stores and provides access to data coming from the LHC and other physics experiments. We implement specialised storage services to provide tools for optimal data management, based on the evolution of data volumes, the available technologies and the o...
Autores principales: | , , , , , , , , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2014
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1088/1742-6596/513/4/042017 http://cds.cern.ch/record/2026331 |
_version_ | 1780947349339635712 |
---|---|
author | Espinal, Xavier Adde, G Chan, B Iven, J Lo Presti, G Lamanna, M Mascetti, L Pace, A Peters, A Ponce, S Sindrilaru, E |
author_facet | Espinal, Xavier Adde, G Chan, B Iven, J Lo Presti, G Lamanna, M Mascetti, L Pace, A Peters, A Ponce, S Sindrilaru, E |
author_sort | Espinal, Xavier |
collection | CERN |
description | The CERN-IT Data Storage and Services (DSS) group stores and provides access to data coming from the LHC and other physics experiments. We implement specialised storage services to provide tools for optimal data management, based on the evolution of data volumes, the available technologies and the observed experiment and users' usage patterns. Our current solutions are CASTOR, for highly-reliable tape-backed storage for heavy-duty Tier-0 workflows, and EOS, for disk-only storage for full-scale analysis activities. CASTOR is evolving towards a simplified disk layer in front of the tape robotics, focusing on recording the primary data from the detectors. EOS is now a well-established storage service used intensively by the four big LHC experiments. Its conceptual design based on multi-replica and in-memory namespace, makes it the perfect system for data intensive workflows. The LHC-Long Shutdown 1 (LSI) presents a window of opportunity to shape up both of our storage services and validate against the ongoing analysis activity in order to successfully face the new LHC data taking period in 2015. In this paper, the current state and foreseen evolutions of CASTOR and EOS will be presented together with a study about the reliability of our systems. |
id | oai-inspirehep.net-1302092 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2014 |
record_format | invenio |
spelling | oai-inspirehep.net-13020922022-08-17T13:29:08Zdoi:10.1088/1742-6596/513/4/042017http://cds.cern.ch/record/2026331engEspinal, XavierAdde, GChan, BIven, JLo Presti, GLamanna, MMascetti, LPace, APeters, APonce, SSindrilaru, EDisk storage at CERN: Handling LHC data and beyondComputing and ComputersThe CERN-IT Data Storage and Services (DSS) group stores and provides access to data coming from the LHC and other physics experiments. We implement specialised storage services to provide tools for optimal data management, based on the evolution of data volumes, the available technologies and the observed experiment and users' usage patterns. Our current solutions are CASTOR, for highly-reliable tape-backed storage for heavy-duty Tier-0 workflows, and EOS, for disk-only storage for full-scale analysis activities. CASTOR is evolving towards a simplified disk layer in front of the tape robotics, focusing on recording the primary data from the detectors. EOS is now a well-established storage service used intensively by the four big LHC experiments. Its conceptual design based on multi-replica and in-memory namespace, makes it the perfect system for data intensive workflows. The LHC-Long Shutdown 1 (LSI) presents a window of opportunity to shape up both of our storage services and validate against the ongoing analysis activity in order to successfully face the new LHC data taking period in 2015. In this paper, the current state and foreseen evolutions of CASTOR and EOS will be presented together with a study about the reliability of our systems.oai:inspirehep.net:13020922014 |
spellingShingle | Computing and Computers Espinal, Xavier Adde, G Chan, B Iven, J Lo Presti, G Lamanna, M Mascetti, L Pace, A Peters, A Ponce, S Sindrilaru, E Disk storage at CERN: Handling LHC data and beyond |
title | Disk storage at CERN: Handling LHC data and beyond |
title_full | Disk storage at CERN: Handling LHC data and beyond |
title_fullStr | Disk storage at CERN: Handling LHC data and beyond |
title_full_unstemmed | Disk storage at CERN: Handling LHC data and beyond |
title_short | Disk storage at CERN: Handling LHC data and beyond |
title_sort | disk storage at cern: handling lhc data and beyond |
topic | Computing and Computers |
url | https://dx.doi.org/10.1088/1742-6596/513/4/042017 http://cds.cern.ch/record/2026331 |
work_keys_str_mv | AT espinalxavier diskstorageatcernhandlinglhcdataandbeyond AT addeg diskstorageatcernhandlinglhcdataandbeyond AT chanb diskstorageatcernhandlinglhcdataandbeyond AT ivenj diskstorageatcernhandlinglhcdataandbeyond AT loprestig diskstorageatcernhandlinglhcdataandbeyond AT lamannam diskstorageatcernhandlinglhcdataandbeyond AT mascettil diskstorageatcernhandlinglhcdataandbeyond AT pacea diskstorageatcernhandlinglhcdataandbeyond AT petersa diskstorageatcernhandlinglhcdataandbeyond AT ponces diskstorageatcernhandlinglhcdataandbeyond AT sindrilarue diskstorageatcernhandlinglhcdataandbeyond |