Cargando…

The first disk-based custodial storage for the ALICE experiment

<!--HTML-->We proposed a disk-based custodial storage as an alternative to tape for the ALICE experiment at CERN to preserve its raw data. The proposed storage system relies on RAIN layout -- the implementation of erasure coding in the EOS storage suite, which is developed by CERN -- for dat...

Descripción completa

Detalles Bibliográficos
Autor principal: Ahn, Sang Un
Lenguaje:eng
Publicado: 2021
Materias:
Acceso en línea:http://cds.cern.ch/record/2766970
_version_ 1780971252198932480
author Ahn, Sang Un
author_facet Ahn, Sang Un
author_sort Ahn, Sang Un
collection CERN
description <!--HTML-->We proposed a disk-based custodial storage as an alternative to tape for the ALICE experiment at CERN to preserve its raw data. The proposed storage system relies on RAIN layout -- the implementation of erasure coding in the EOS storage suite, which is developed by CERN -- for data protection and takes full advantage of high-density JBOD enclosures to maximize storage capacity as well as to achieve cost-effectiveness comparable to tape. The system we present provides 18 PB of total raw capacity from the 18 set of high-density JBOD enclosures attached to 9 EOS front-end servers. In order to balance between usable space and data protection, the system will stripe a file into 16 chunks on the 4-parity enabled RAIN layout configured on top of 18 containerized EOS FSTs. Although the reduction rate of available space increases up to $33.3\%$ with this layout, the estimated annual data loss rate drops down to $8.6 \times 10^{-5}\%$. In this paper, we discuss the system architecture of the disk-based custodial storage, 4-parity RAIN layout, deployment automation, and the integration to the ALICE experiment in detail.
id cern-2766970
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2021
record_format invenio
spelling cern-27669702022-11-02T22:25:52Zhttp://cds.cern.ch/record/2766970engAhn, Sang UnThe first disk-based custodial storage for the ALICE experiment25th International Conference on Computing in High Energy & Nuclear PhysicsConferences<!--HTML-->We proposed a disk-based custodial storage as an alternative to tape for the ALICE experiment at CERN to preserve its raw data. The proposed storage system relies on RAIN layout -- the implementation of erasure coding in the EOS storage suite, which is developed by CERN -- for data protection and takes full advantage of high-density JBOD enclosures to maximize storage capacity as well as to achieve cost-effectiveness comparable to tape. The system we present provides 18 PB of total raw capacity from the 18 set of high-density JBOD enclosures attached to 9 EOS front-end servers. In order to balance between usable space and data protection, the system will stripe a file into 16 chunks on the 4-parity enabled RAIN layout configured on top of 18 containerized EOS FSTs. Although the reduction rate of available space increases up to $33.3\%$ with this layout, the estimated annual data loss rate drops down to $8.6 \times 10^{-5}\%$. In this paper, we discuss the system architecture of the disk-based custodial storage, 4-parity RAIN layout, deployment automation, and the integration to the ALICE experiment in detail.oai:cds.cern.ch:27669702021
spellingShingle Conferences
Ahn, Sang Un
The first disk-based custodial storage for the ALICE experiment
title The first disk-based custodial storage for the ALICE experiment
title_full The first disk-based custodial storage for the ALICE experiment
title_fullStr The first disk-based custodial storage for the ALICE experiment
title_full_unstemmed The first disk-based custodial storage for the ALICE experiment
title_short The first disk-based custodial storage for the ALICE experiment
title_sort first disk-based custodial storage for the alice experiment
topic Conferences
url http://cds.cern.ch/record/2766970
work_keys_str_mv AT ahnsangun thefirstdiskbasedcustodialstorageforthealiceexperiment
AT ahnsangun 25thinternationalconferenceoncomputinginhighenergynuclearphysics
AT ahnsangun firstdiskbasedcustodialstorageforthealiceexperiment