Cargando…
The first disk-based custodial storage for the ALICE experiment
<!--HTML-->We proposed a disk-based custodial storage as an alternative to tape for the ALICE experiment at CERN to preserve its raw data. The proposed storage system relies on RAIN layout -- the implementation of erasure coding in the EOS storage suite, which is developed by CERN -- for dat...
Autor principal: | |
---|---|
Lenguaje: | eng |
Publicado: |
2021
|
Materias: | |
Acceso en línea: | http://cds.cern.ch/record/2766970 |
_version_ | 1780971252198932480 |
---|---|
author | Ahn, Sang Un |
author_facet | Ahn, Sang Un |
author_sort | Ahn, Sang Un |
collection | CERN |
description | <!--HTML-->We proposed a disk-based custodial storage as an alternative to tape for the ALICE experiment at CERN to preserve its raw data.
The proposed storage system relies on RAIN layout -- the implementation of erasure coding in the EOS storage suite, which is developed by CERN -- for data protection and takes full advantage of high-density JBOD enclosures to maximize storage capacity as well as to achieve cost-effectiveness comparable to tape.
The system we present provides 18 PB of total raw capacity from the 18 set of high-density JBOD enclosures attached to 9 EOS front-end servers.
In order to balance between usable space and data protection, the system will stripe a file into 16 chunks on the 4-parity enabled RAIN layout configured on top of 18 containerized EOS FSTs.
Although the reduction rate of available space increases up to $33.3\%$ with this layout, the estimated annual data loss rate drops down to $8.6 \times 10^{-5}\%$.
In this paper, we discuss the system architecture of the disk-based custodial storage, 4-parity RAIN layout, deployment automation, and the integration to the ALICE experiment in detail. |
id | cern-2766970 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2021 |
record_format | invenio |
spelling | cern-27669702022-11-02T22:25:52Zhttp://cds.cern.ch/record/2766970engAhn, Sang UnThe first disk-based custodial storage for the ALICE experiment25th International Conference on Computing in High Energy & Nuclear PhysicsConferences<!--HTML-->We proposed a disk-based custodial storage as an alternative to tape for the ALICE experiment at CERN to preserve its raw data. The proposed storage system relies on RAIN layout -- the implementation of erasure coding in the EOS storage suite, which is developed by CERN -- for data protection and takes full advantage of high-density JBOD enclosures to maximize storage capacity as well as to achieve cost-effectiveness comparable to tape. The system we present provides 18 PB of total raw capacity from the 18 set of high-density JBOD enclosures attached to 9 EOS front-end servers. In order to balance between usable space and data protection, the system will stripe a file into 16 chunks on the 4-parity enabled RAIN layout configured on top of 18 containerized EOS FSTs. Although the reduction rate of available space increases up to $33.3\%$ with this layout, the estimated annual data loss rate drops down to $8.6 \times 10^{-5}\%$. In this paper, we discuss the system architecture of the disk-based custodial storage, 4-parity RAIN layout, deployment automation, and the integration to the ALICE experiment in detail.oai:cds.cern.ch:27669702021 |
spellingShingle | Conferences Ahn, Sang Un The first disk-based custodial storage for the ALICE experiment |
title | The first disk-based custodial storage for the ALICE experiment |
title_full | The first disk-based custodial storage for the ALICE experiment |
title_fullStr | The first disk-based custodial storage for the ALICE experiment |
title_full_unstemmed | The first disk-based custodial storage for the ALICE experiment |
title_short | The first disk-based custodial storage for the ALICE experiment |
title_sort | first disk-based custodial storage for the alice experiment |
topic | Conferences |
url | http://cds.cern.ch/record/2766970 |
work_keys_str_mv | AT ahnsangun thefirstdiskbasedcustodialstorageforthealiceexperiment AT ahnsangun 25thinternationalconferenceoncomputinginhighenergynuclearphysics AT ahnsangun firstdiskbasedcustodialstorageforthealiceexperiment |