Cargando…

MeerKAT Ceph updates from Mzanzi

<!--HTML-->MeerKAT, one of the SKA (Square Kilometer Array) precursor telescopes, was inaugurated on the 13th of July 2018 in South Africa. We would like to update the Ceph community with progress and activities relating to the MeerKAT project with a particular focus on MeerKAT data storage....

Descripción completa

Detalles Bibliográficos
Autor principal: Bennett, Thomas
Lenguaje:eng
Publicado: 2019
Materias:
Acceso en línea:http://cds.cern.ch/record/2691062
_version_ 1780963804211838976
author Bennett, Thomas
author_facet Bennett, Thomas
author_sort Bennett, Thomas
collection CERN
description <!--HTML-->MeerKAT, one of the SKA (Square Kilometer Array) precursor telescopes, was inaugurated on the 13th of July 2018 in South Africa. We would like to update the Ceph community with progress and activities relating to the MeerKAT project with a particular focus on MeerKAT data storage. A number of Ceph RADOS Gateway instances have been implemented for MeerKAT. We will present these use-cases, their current configurations and implementations. We will also discuss the development of bespoke software stacks for data transfer and an end user data access layer. After two years of using Ceph, the MeerKAT data storage team is also reflecting on what we have learned and where we should focus our efforts w.r.t. Ceph and the Ceph community. Since our first production cluster, we have been using ceph-ansible for deployment, which has suited or needs. However, looking forward, we have begun developing our own Ceph deployment process. We have also been through a number of iterations of monitoring and alerting infrastructure for our Ceph production clusters. Our current efforts have been to use a stripped down version of the ceph-metrics for our Prometheus driven Grafana dashboards. We are also in the process of growing our small Ceph community in South African. Currently this is being driven through meetup events, discussion forums and presentations at local workshops and conferences. Leveraging the perception of MeerKAT we are hoping to reach a wider audience and raise awareness of Ceph.
id cern-2691062
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2019
record_format invenio
spelling cern-26910622022-11-02T22:07:48Zhttp://cds.cern.ch/record/2691062engBennett, ThomasMeerKAT Ceph updates from MzanziCeph Day for Research and Non-profitsCeph Project<!--HTML-->MeerKAT, one of the SKA (Square Kilometer Array) precursor telescopes, was inaugurated on the 13th of July 2018 in South Africa. We would like to update the Ceph community with progress and activities relating to the MeerKAT project with a particular focus on MeerKAT data storage. A number of Ceph RADOS Gateway instances have been implemented for MeerKAT. We will present these use-cases, their current configurations and implementations. We will also discuss the development of bespoke software stacks for data transfer and an end user data access layer. After two years of using Ceph, the MeerKAT data storage team is also reflecting on what we have learned and where we should focus our efforts w.r.t. Ceph and the Ceph community. Since our first production cluster, we have been using ceph-ansible for deployment, which has suited or needs. However, looking forward, we have begun developing our own Ceph deployment process. We have also been through a number of iterations of monitoring and alerting infrastructure for our Ceph production clusters. Our current efforts have been to use a stripped down version of the ceph-metrics for our Prometheus driven Grafana dashboards. We are also in the process of growing our small Ceph community in South African. Currently this is being driven through meetup events, discussion forums and presentations at local workshops and conferences. Leveraging the perception of MeerKAT we are hoping to reach a wider audience and raise awareness of Ceph.oai:cds.cern.ch:26910622019
spellingShingle Ceph Project
Bennett, Thomas
MeerKAT Ceph updates from Mzanzi
title MeerKAT Ceph updates from Mzanzi
title_full MeerKAT Ceph updates from Mzanzi
title_fullStr MeerKAT Ceph updates from Mzanzi
title_full_unstemmed MeerKAT Ceph updates from Mzanzi
title_short MeerKAT Ceph updates from Mzanzi
title_sort meerkat ceph updates from mzanzi
topic Ceph Project
url http://cds.cern.ch/record/2691062
work_keys_str_mv AT bennettthomas meerkatcephupdatesfrommzanzi
AT bennettthomas cephdayforresearchandnonprofits