Utilising Ceph for large scale, high throughput storage to support the LHC experiments

<!--HTML-->Our large erasure coded ceph cluster is used by the four large LHC experiments for scientific data storage, providing 30PB of usable storage and averaging a 30GB/s read rate to the analysis cluster. In this talk I will talk about the architecture of the system, and how we have optim...

Descripción completa

Detalles Bibliográficos
Autor principal: Byrne, Tom
Lenguaje:eng
Publicado: 2019
Materias:
Ceph Project
Acceso en línea:http://cds.cern.ch/record/2690997
_version_ 1780963802034995200
author Byrne, Tom
author_facet Byrne, Tom
author_sort Byrne, Tom
collection CERN
description <!--HTML-->Our large erasure coded ceph cluster is used by the four large LHC experiments for scientific data storage, providing 30PB of usable storage and averaging a 30GB/s read rate to the analysis cluster. In this talk I will talk about the architecture of the system, and how we have optimised it to allow us to reliably support a large transfer rate. I will also discuss some of the issues, and solutions, surrounding transfer performance monitoring in our architecture.
id cern-2690997
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2019
record_format invenio
spelling cern-26909972022-11-02T22:07:48Zhttp://cds.cern.ch/record/2690997engByrne, TomUtilising Ceph for large scale, high throughput storage to support the LHC experimentsCeph Day for Research and Non-profitsCeph Project<!--HTML-->Our large erasure coded ceph cluster is used by the four large LHC experiments for scientific data storage, providing 30PB of usable storage and averaging a 30GB/s read rate to the analysis cluster. In this talk I will talk about the architecture of the system, and how we have optimised it to allow us to reliably support a large transfer rate. I will also discuss some of the issues, and solutions, surrounding transfer performance monitoring in our architecture.oai:cds.cern.ch:26909972019
spellingShingle Ceph Project
Byrne, Tom
Utilising Ceph for large scale, high throughput storage to support the LHC experiments
title Utilising Ceph for large scale, high throughput storage to support the LHC experiments
title_full Utilising Ceph for large scale, high throughput storage to support the LHC experiments
title_fullStr Utilising Ceph for large scale, high throughput storage to support the LHC experiments
title_full_unstemmed Utilising Ceph for large scale, high throughput storage to support the LHC experiments
title_short Utilising Ceph for large scale, high throughput storage to support the LHC experiments
title_sort utilising ceph for large scale, high throughput storage to support the lhc experiments
topic Ceph Project
url http://cds.cern.ch/record/2690997
work_keys_str_mv AT byrnetom utilisingcephforlargescalehighthroughputstoragetosupportthelhcexperiments
AT byrnetom cephdayforresearchandnonprofits

Ejemplares similares