Ad-hoc filesystems for dynamic science workloads

<!--HTML-->In this talk, we present recent work supporting the computing demands of the Euclid space mission using resources from across an OpenStack federation for scientific computing. CephFS is used to present a single coherent filesystem drawing upon resources from multiple sites. We pre...

Descripción completa

Detalles Bibliográficos
Autores principales: Garbutt, John, Telfer, Stig
Lenguaje:eng
Publicado: 2019
Materias:
Ceph Project
Acceso en línea:http://cds.cern.ch/record/2691828
_version_ 1780963909617844224
author Garbutt, John
Telfer, Stig
author_facet Garbutt, John
Telfer, Stig
author_sort Garbutt, John
collection CERN
description <!--HTML-->In this talk, we present recent work supporting the computing demands of the Euclid space mission using resources from across an OpenStack federation for scientific computing. CephFS is used to present a single coherent filesystem drawing upon resources from multiple sites. We present our approach and experiences. We then present an alternative approach to filesystems on-the-fly using the Data Accelerator project at Cambridge University, currently #1 in the global IO-500 list. We provide an overview of the technologies involved and an analysis of how its high performance levels are achieved.
id cern-2691828
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2019
record_format invenio
spelling cern-26918282022-11-02T22:07:39Zhttp://cds.cern.ch/record/2691828engGarbutt, JohnTelfer, StigAd-hoc filesystems for dynamic science workloadsCeph Day for Research and Non-profitsCeph Project<!--HTML-->In this talk, we present recent work supporting the computing demands of the Euclid space mission using resources from across an OpenStack federation for scientific computing. CephFS is used to present a single coherent filesystem drawing upon resources from multiple sites. We present our approach and experiences. We then present an alternative approach to filesystems on-the-fly using the Data Accelerator project at Cambridge University, currently #1 in the global IO-500 list. We provide an overview of the technologies involved and an analysis of how its high performance levels are achieved.oai:cds.cern.ch:26918282019
spellingShingle Ceph Project
Garbutt, John
Telfer, Stig
Ad-hoc filesystems for dynamic science workloads
title Ad-hoc filesystems for dynamic science workloads
title_full Ad-hoc filesystems for dynamic science workloads
title_fullStr Ad-hoc filesystems for dynamic science workloads
title_full_unstemmed Ad-hoc filesystems for dynamic science workloads
title_short Ad-hoc filesystems for dynamic science workloads
title_sort ad-hoc filesystems for dynamic science workloads
topic Ceph Project
url http://cds.cern.ch/record/2691828
work_keys_str_mv AT garbuttjohn adhocfilesystemsfordynamicscienceworkloads
AT telferstig adhocfilesystemsfordynamicscienceworkloads
AT garbuttjohn cephdayforresearchandnonprofits
AT telferstig cephdayforresearchandnonprofits

Ejemplares similares