Cargando…

Ceph Supporting Genetic Research at The Wellcome Sanger Institute

<!--HTML-->The Wellcome Sanger Institute has 18PB in its largest Ceph cluster. This talk will explain how the Sanger used Ceph to build and scale a reliable platform for scientific computing, and enable secure data sharing via S3. And how they got 100GB/s read performance out of their cluster....

Descripción completa

Detalles Bibliográficos
Autor principal: Vernon, Matthew
Lenguaje:eng
Publicado: 2019
Materias:
Acceso en línea:http://cds.cern.ch/record/2690994
_version_ 1780963801609273344
author Vernon, Matthew
author_facet Vernon, Matthew
author_sort Vernon, Matthew
collection CERN
description <!--HTML-->The Wellcome Sanger Institute has 18PB in its largest Ceph cluster. This talk will explain how the Sanger used Ceph to build and scale a reliable platform for scientific computing, and enable secure data sharing via S3. And how they got 100GB/s read performance out of their cluster. Matthew will outline the interesting aspects of the Sanger's Ceph setup, including how the team grew it from a small initial installation, automated deployment management and monitoring, and some of the issues they have encountered along the way. Matthew will also explore some of the good (and less good!) aspects of running Ceph at scale, and supporting scientific workflows.
id cern-2690994
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2019
record_format invenio
spelling cern-26909942022-11-02T22:07:48Zhttp://cds.cern.ch/record/2690994engVernon, MatthewCeph Supporting Genetic Research at The Wellcome Sanger InstituteCeph Day for Research and Non-profitsCeph Project<!--HTML-->The Wellcome Sanger Institute has 18PB in its largest Ceph cluster. This talk will explain how the Sanger used Ceph to build and scale a reliable platform for scientific computing, and enable secure data sharing via S3. And how they got 100GB/s read performance out of their cluster. Matthew will outline the interesting aspects of the Sanger's Ceph setup, including how the team grew it from a small initial installation, automated deployment management and monitoring, and some of the issues they have encountered along the way. Matthew will also explore some of the good (and less good!) aspects of running Ceph at scale, and supporting scientific workflows.oai:cds.cern.ch:26909942019
spellingShingle Ceph Project
Vernon, Matthew
Ceph Supporting Genetic Research at The Wellcome Sanger Institute
title Ceph Supporting Genetic Research at The Wellcome Sanger Institute
title_full Ceph Supporting Genetic Research at The Wellcome Sanger Institute
title_fullStr Ceph Supporting Genetic Research at The Wellcome Sanger Institute
title_full_unstemmed Ceph Supporting Genetic Research at The Wellcome Sanger Institute
title_short Ceph Supporting Genetic Research at The Wellcome Sanger Institute
title_sort ceph supporting genetic research at the wellcome sanger institute
topic Ceph Project
url http://cds.cern.ch/record/2690994
work_keys_str_mv AT vernonmatthew cephsupportinggeneticresearchatthewellcomesangerinstitute
AT vernonmatthew cephdayforresearchandnonprofits