Cargando…
CERN data services for LHC computing
Dependability, resilience, adaptability and efficiency. Growing requirements require tailoring storage services and novel solutions. Unprecedented volumes of data coming from the broad number of experiments at CERN need to be quickly available in a highly scalable way for large-scale processing and...
Autores principales: | , , , , , , , , , , , , , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2017
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1088/1742-6596/898/6/062028 http://cds.cern.ch/record/2297054 |
_version_ | 1780956903229095936 |
---|---|
author | Espinal, X Bocchi, E Chan, B Fiorot, A Iven, J Lo Presti, G Lopez, J Gonzalez, H Lamanna, M Mascetti, L Moscicki, J Pace, A Peters, A Ponce, S Rousseau, H van der Ster, D |
author_facet | Espinal, X Bocchi, E Chan, B Fiorot, A Iven, J Lo Presti, G Lopez, J Gonzalez, H Lamanna, M Mascetti, L Moscicki, J Pace, A Peters, A Ponce, S Rousseau, H van der Ster, D |
author_sort | Espinal, X |
collection | CERN |
description | Dependability, resilience, adaptability and efficiency. Growing requirements require tailoring storage services and novel solutions. Unprecedented volumes of data coming from the broad number of experiments at CERN need to be quickly available in a highly scalable way for large-scale processing and data distribution while in parallel they are routed to tape for long-term archival. These activities are critical for the success of HEP experiments. Nowadays we operate at high incoming throughput (14GB/s during 2015 LHC Pb-Pb run and 11PB in July 2016) and with concurrent complex production work-loads. In parallel our systems provide the platform for the continuous user and experiment driven work-loads for large-scale data analysis, including end-user access and sharing. The storage services at CERN cover the needs of our community: EOS and CASTOR as a large-scale storage; CERNBox for end-user access and sharing; Ceph as data back-end for the CERN OpenStack infrastructure, NFS services and S3 functionality; AFS for legacy distributed-file-system services. In this paper we will summarise the experience in supporting LHC experiments and the transition of our infrastructure from static monolithic systems to flexible components providing a more coherent environment with pluggable protocols, tuneable QoS, sharing capabilities and fine grained ACLs management while continuing to guarantee dependable and robust services. |
id | oai-inspirehep.net-1638518 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2017 |
record_format | invenio |
spelling | oai-inspirehep.net-16385182021-02-09T10:06:46Zdoi:10.1088/1742-6596/898/6/062028http://cds.cern.ch/record/2297054engEspinal, XBocchi, EChan, BFiorot, AIven, JLo Presti, GLopez, JGonzalez, HLamanna, MMascetti, LMoscicki, JPace, APeters, APonce, SRousseau, Hvan der Ster, DCERN data services for LHC computingComputing and ComputersDependability, resilience, adaptability and efficiency. Growing requirements require tailoring storage services and novel solutions. Unprecedented volumes of data coming from the broad number of experiments at CERN need to be quickly available in a highly scalable way for large-scale processing and data distribution while in parallel they are routed to tape for long-term archival. These activities are critical for the success of HEP experiments. Nowadays we operate at high incoming throughput (14GB/s during 2015 LHC Pb-Pb run and 11PB in July 2016) and with concurrent complex production work-loads. In parallel our systems provide the platform for the continuous user and experiment driven work-loads for large-scale data analysis, including end-user access and sharing. The storage services at CERN cover the needs of our community: EOS and CASTOR as a large-scale storage; CERNBox for end-user access and sharing; Ceph as data back-end for the CERN OpenStack infrastructure, NFS services and S3 functionality; AFS for legacy distributed-file-system services. In this paper we will summarise the experience in supporting LHC experiments and the transition of our infrastructure from static monolithic systems to flexible components providing a more coherent environment with pluggable protocols, tuneable QoS, sharing capabilities and fine grained ACLs management while continuing to guarantee dependable and robust services.oai:inspirehep.net:16385182017 |
spellingShingle | Computing and Computers Espinal, X Bocchi, E Chan, B Fiorot, A Iven, J Lo Presti, G Lopez, J Gonzalez, H Lamanna, M Mascetti, L Moscicki, J Pace, A Peters, A Ponce, S Rousseau, H van der Ster, D CERN data services for LHC computing |
title | CERN data services for LHC computing |
title_full | CERN data services for LHC computing |
title_fullStr | CERN data services for LHC computing |
title_full_unstemmed | CERN data services for LHC computing |
title_short | CERN data services for LHC computing |
title_sort | cern data services for lhc computing |
topic | Computing and Computers |
url | https://dx.doi.org/10.1088/1742-6596/898/6/062028 http://cds.cern.ch/record/2297054 |
work_keys_str_mv | AT espinalx cerndataservicesforlhccomputing AT bocchie cerndataservicesforlhccomputing AT chanb cerndataservicesforlhccomputing AT fiorota cerndataservicesforlhccomputing AT ivenj cerndataservicesforlhccomputing AT loprestig cerndataservicesforlhccomputing AT lopezj cerndataservicesforlhccomputing AT gonzalezh cerndataservicesforlhccomputing AT lamannam cerndataservicesforlhccomputing AT mascettil cerndataservicesforlhccomputing AT moscickij cerndataservicesforlhccomputing AT pacea cerndataservicesforlhccomputing AT petersa cerndataservicesforlhccomputing AT ponces cerndataservicesforlhccomputing AT rousseauh cerndataservicesforlhccomputing AT vandersterd cerndataservicesforlhccomputing |