Cargando…

CERN data services for LHC computing

Dependability, resilience, adaptability and efficiency. Growing requirements require tailoring storage services and novel solutions. Unprecedented volumes of data coming from the broad number of experiments at CERN need to be quickly available in a highly scalable way for large-scale processing and...

Descripción completa

Detalles Bibliográficos
Autores principales: Espinal, X, Bocchi, E, Chan, B, Fiorot, A, Iven, J, Lo Presti, G, Lopez, J, Gonzalez, H, Lamanna, M, Mascetti, L, Moscicki, J, Pace, A, Peters, A, Ponce, S, Rousseau, H, van der Ster, D
Lenguaje:eng
Publicado: 2017
Materias:
Acceso en línea:https://dx.doi.org/10.1088/1742-6596/898/6/062028
http://cds.cern.ch/record/2297054
_version_ 1780956903229095936
author Espinal, X
Bocchi, E
Chan, B
Fiorot, A
Iven, J
Lo Presti, G
Lopez, J
Gonzalez, H
Lamanna, M
Mascetti, L
Moscicki, J
Pace, A
Peters, A
Ponce, S
Rousseau, H
van der Ster, D
author_facet Espinal, X
Bocchi, E
Chan, B
Fiorot, A
Iven, J
Lo Presti, G
Lopez, J
Gonzalez, H
Lamanna, M
Mascetti, L
Moscicki, J
Pace, A
Peters, A
Ponce, S
Rousseau, H
van der Ster, D
author_sort Espinal, X
collection CERN
description Dependability, resilience, adaptability and efficiency. Growing requirements require tailoring storage services and novel solutions. Unprecedented volumes of data coming from the broad number of experiments at CERN need to be quickly available in a highly scalable way for large-scale processing and data distribution while in parallel they are routed to tape for long-term archival. These activities are critical for the success of HEP experiments. Nowadays we operate at high incoming throughput (14GB/s during 2015 LHC Pb-Pb run and 11PB in July 2016) and with concurrent complex production work-loads. In parallel our systems provide the platform for the continuous user and experiment driven work-loads for large-scale data analysis, including end-user access and sharing. The storage services at CERN cover the needs of our community: EOS and CASTOR as a large-scale storage; CERNBox for end-user access and sharing; Ceph as data back-end for the CERN OpenStack infrastructure, NFS services and S3 functionality; AFS for legacy distributed-file-system services. In this paper we will summarise the experience in supporting LHC experiments and the transition of our infrastructure from static monolithic systems to flexible components providing a more coherent environment with pluggable protocols, tuneable QoS, sharing capabilities and fine grained ACLs management while continuing to guarantee dependable and robust services.
id oai-inspirehep.net-1638518
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2017
record_format invenio
spelling oai-inspirehep.net-16385182021-02-09T10:06:46Zdoi:10.1088/1742-6596/898/6/062028http://cds.cern.ch/record/2297054engEspinal, XBocchi, EChan, BFiorot, AIven, JLo Presti, GLopez, JGonzalez, HLamanna, MMascetti, LMoscicki, JPace, APeters, APonce, SRousseau, Hvan der Ster, DCERN data services for LHC computingComputing and ComputersDependability, resilience, adaptability and efficiency. Growing requirements require tailoring storage services and novel solutions. Unprecedented volumes of data coming from the broad number of experiments at CERN need to be quickly available in a highly scalable way for large-scale processing and data distribution while in parallel they are routed to tape for long-term archival. These activities are critical for the success of HEP experiments. Nowadays we operate at high incoming throughput (14GB/s during 2015 LHC Pb-Pb run and 11PB in July 2016) and with concurrent complex production work-loads. In parallel our systems provide the platform for the continuous user and experiment driven work-loads for large-scale data analysis, including end-user access and sharing. The storage services at CERN cover the needs of our community: EOS and CASTOR as a large-scale storage; CERNBox for end-user access and sharing; Ceph as data back-end for the CERN OpenStack infrastructure, NFS services and S3 functionality; AFS for legacy distributed-file-system services. In this paper we will summarise the experience in supporting LHC experiments and the transition of our infrastructure from static monolithic systems to flexible components providing a more coherent environment with pluggable protocols, tuneable QoS, sharing capabilities and fine grained ACLs management while continuing to guarantee dependable and robust services.oai:inspirehep.net:16385182017
spellingShingle Computing and Computers
Espinal, X
Bocchi, E
Chan, B
Fiorot, A
Iven, J
Lo Presti, G
Lopez, J
Gonzalez, H
Lamanna, M
Mascetti, L
Moscicki, J
Pace, A
Peters, A
Ponce, S
Rousseau, H
van der Ster, D
CERN data services for LHC computing
title CERN data services for LHC computing
title_full CERN data services for LHC computing
title_fullStr CERN data services for LHC computing
title_full_unstemmed CERN data services for LHC computing
title_short CERN data services for LHC computing
title_sort cern data services for lhc computing
topic Computing and Computers
url https://dx.doi.org/10.1088/1742-6596/898/6/062028
http://cds.cern.ch/record/2297054
work_keys_str_mv AT espinalx cerndataservicesforlhccomputing
AT bocchie cerndataservicesforlhccomputing
AT chanb cerndataservicesforlhccomputing
AT fiorota cerndataservicesforlhccomputing
AT ivenj cerndataservicesforlhccomputing
AT loprestig cerndataservicesforlhccomputing
AT lopezj cerndataservicesforlhccomputing
AT gonzalezh cerndataservicesforlhccomputing
AT lamannam cerndataservicesforlhccomputing
AT mascettil cerndataservicesforlhccomputing
AT moscickij cerndataservicesforlhccomputing
AT pacea cerndataservicesforlhccomputing
AT petersa cerndataservicesforlhccomputing
AT ponces cerndataservicesforlhccomputing
AT rousseauh cerndataservicesforlhccomputing
AT vandersterd cerndataservicesforlhccomputing