Cargando…
Empowering CERNBox users with self-service restore functionality
<!--HTML-->The IT storage group at CERN is resposible to ensure integrity and security of all the stored data for physics and general computing services. In the last years a backup orchestrator, cback, has been developed based on the open source backup software restic. Cback is able to backup...
Autor principal: | |
---|---|
Lenguaje: | eng |
Publicado: |
2023
|
Materias: | |
Acceso en línea: | http://cds.cern.ch/record/2857156 |
_version_ | 1780977550385741824 |
---|---|
author | Del Monte, Gianmaria |
author_facet | Del Monte, Gianmaria |
author_sort | Del Monte, Gianmaria |
collection | CERN |
description | <!--HTML-->The IT storage group at CERN is resposible to ensure integrity and security of all the stored data for physics and general computing services. In the last years a backup orchestrator, cback, has been developed based on the open source backup software restic. Cback is able to backup EOS, CephFS and any local mountable file system, like NFS or DFS. cback is currently used to daily backup CERNBox data (2.5 billion of files and 18PB), including experiment project spaces and user home directories.
The data copy is stored in a disk-based S3 cluster in another geographical location in the CERN campus 4km away from the main data center (protecting against natural disasters). The usage of restic allows us to reduce the storage costs thanks to the deduplication of the data. In the last months, the cback portal server has been implemented, exposing a set of REST APIs to allow the intergration with end-user backup utilities to navigate snapshots and restore data.
In this presentation, we will describe the architecture and the implementation of cback, the integration with CERNBox and the future integration with tape archive (CTA) for long term data preservation. |
id | cern-2857156 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2023 |
record_format | invenio |
spelling | cern-28571562023-04-28T19:12:49Zhttp://cds.cern.ch/record/2857156engDel Monte, GianmariaEmpowering CERNBox users with self-service restore functionalityEOS 2023 WorkshopHEP Computing<!--HTML-->The IT storage group at CERN is resposible to ensure integrity and security of all the stored data for physics and general computing services. In the last years a backup orchestrator, cback, has been developed based on the open source backup software restic. Cback is able to backup EOS, CephFS and any local mountable file system, like NFS or DFS. cback is currently used to daily backup CERNBox data (2.5 billion of files and 18PB), including experiment project spaces and user home directories. The data copy is stored in a disk-based S3 cluster in another geographical location in the CERN campus 4km away from the main data center (protecting against natural disasters). The usage of restic allows us to reduce the storage costs thanks to the deduplication of the data. In the last months, the cback portal server has been implemented, exposing a set of REST APIs to allow the intergration with end-user backup utilities to navigate snapshots and restore data. In this presentation, we will describe the architecture and the implementation of cback, the integration with CERNBox and the future integration with tape archive (CTA) for long term data preservation.oai:cds.cern.ch:28571562023 |
spellingShingle | HEP Computing Del Monte, Gianmaria Empowering CERNBox users with self-service restore functionality |
title | Empowering CERNBox users with self-service restore functionality |
title_full | Empowering CERNBox users with self-service restore functionality |
title_fullStr | Empowering CERNBox users with self-service restore functionality |
title_full_unstemmed | Empowering CERNBox users with self-service restore functionality |
title_short | Empowering CERNBox users with self-service restore functionality |
title_sort | empowering cernbox users with self-service restore functionality |
topic | HEP Computing |
url | http://cds.cern.ch/record/2857156 |
work_keys_str_mv | AT delmontegianmaria empoweringcernboxuserswithselfservicerestorefunctionality AT delmontegianmaria eos2023workshop |