Cargando…

Empowering CERNBox users with self-service restore functionality

<!--HTML-->The IT storage group at CERN is resposible to ensure integrity and security of all the stored data for physics and general computing services. In the last years a backup orchestrator, cback, has been developed based on the open source backup software restic. Cback is able to backup...

Descripción completa

Detalles Bibliográficos
Autor principal: Del Monte, Gianmaria
Lenguaje:eng
Publicado: 2023
Materias:
Acceso en línea:http://cds.cern.ch/record/2857156
_version_ 1780977550385741824
author Del Monte, Gianmaria
author_facet Del Monte, Gianmaria
author_sort Del Monte, Gianmaria
collection CERN
description <!--HTML-->The IT storage group at CERN is resposible to ensure integrity and security of all the stored data for physics and general computing services. In the last years a backup orchestrator, cback, has been developed based on the open source backup software restic. Cback is able to backup EOS, CephFS and any local mountable file system, like NFS or DFS. cback is currently used to daily backup CERNBox data (2.5 billion of files and 18PB), including experiment project spaces and user home directories. The data copy is stored in a disk-based S3 cluster in another geographical location in the CERN campus 4km away from the main data center (protecting against natural disasters). The usage of restic allows us to reduce the storage costs thanks to the deduplication of the data. In the last months, the cback portal server has been implemented, exposing a set of REST APIs to allow the intergration with end-user backup utilities to navigate snapshots and restore data. In this presentation, we will describe the architecture and the implementation of cback, the integration with CERNBox and the future integration with tape archive (CTA) for long term data preservation.
id cern-2857156
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2023
record_format invenio
spelling cern-28571562023-04-28T19:12:49Zhttp://cds.cern.ch/record/2857156engDel Monte, GianmariaEmpowering CERNBox users with self-service restore functionalityEOS 2023 WorkshopHEP Computing<!--HTML-->The IT storage group at CERN is resposible to ensure integrity and security of all the stored data for physics and general computing services. In the last years a backup orchestrator, cback, has been developed based on the open source backup software restic. Cback is able to backup EOS, CephFS and any local mountable file system, like NFS or DFS. cback is currently used to daily backup CERNBox data (2.5 billion of files and 18PB), including experiment project spaces and user home directories. The data copy is stored in a disk-based S3 cluster in another geographical location in the CERN campus 4km away from the main data center (protecting against natural disasters). The usage of restic allows us to reduce the storage costs thanks to the deduplication of the data. In the last months, the cback portal server has been implemented, exposing a set of REST APIs to allow the intergration with end-user backup utilities to navigate snapshots and restore data. In this presentation, we will describe the architecture and the implementation of cback, the integration with CERNBox and the future integration with tape archive (CTA) for long term data preservation.oai:cds.cern.ch:28571562023
spellingShingle HEP Computing
Del Monte, Gianmaria
Empowering CERNBox users with self-service restore functionality
title Empowering CERNBox users with self-service restore functionality
title_full Empowering CERNBox users with self-service restore functionality
title_fullStr Empowering CERNBox users with self-service restore functionality
title_full_unstemmed Empowering CERNBox users with self-service restore functionality
title_short Empowering CERNBox users with self-service restore functionality
title_sort empowering cernbox users with self-service restore functionality
topic HEP Computing
url http://cds.cern.ch/record/2857156
work_keys_str_mv AT delmontegianmaria empoweringcernboxuserswithselfservicerestorefunctionality
AT delmontegianmaria eos2023workshop