Cargando…
The first disk-based custodial storage for the ALICE experiment
We proposed a disk-based custodial storage as an alternative to tape for the ALICE experiment at CERN to preserve its raw data. The proposed storage system relies on Redundant Array of Independent Nodes (RAIN) layout – the implementation of erasure coding in the EOS storage suite, which is developed...
Autores principales: | , , , , |
---|---|
Lenguaje: | eng |
Publicado: |
2021
|
Materias: | |
Acceso en línea: | https://dx.doi.org/10.1051/epjconf/202125102051 http://cds.cern.ch/record/2814347 |
_version_ | 1780973438904565760 |
---|---|
author | Un Ahn, Sang Kim, Jeongheon Han, Heejune Lee, Seung Hee Yoon, Heejun |
author_facet | Un Ahn, Sang Kim, Jeongheon Han, Heejune Lee, Seung Hee Yoon, Heejun |
author_sort | Un Ahn, Sang |
collection | CERN |
description | We proposed a disk-based custodial storage as an alternative to tape for the ALICE experiment at CERN to preserve its raw data. The proposed storage system relies on Redundant Array of Independent Nodes (RAIN) layout – the implementation of erasure coding in the EOS storage suite, which is developed by CERN – for data protection and takes full advantage of high-density Just-Bunch-Of-Disks (JBOD) enclosures to maximize storage capacity as well as to achieve cost-effectiveness comparable to tape. The system we present provides 18 PB of total raw capacity from the 18 set of high-density JBOD enclosures attached to 9 EOS front-end servers. In order to balance between usable space and data protection, the system will stripe a file into 16 chunks on the 4-parity enabled RAIN layout configured on top of 18 containerized EOS FSTs. Although the reduction rate of available space increases up to 33:3% with this layout, the estimated annual data loss rate drops down to 8:6 × 10−5%. In this paper, we discuss the system architecture of the disk-based custodial storage, 4-parity RAIN layout, deployment automation, and the integration to the ALICE experiment in detail. |
id | cern-2814347 |
institution | Organización Europea para la Investigación Nuclear |
language | eng |
publishDate | 2021 |
record_format | invenio |
spelling | cern-28143472022-08-17T19:58:26Zdoi:10.1051/epjconf/202125102051http://cds.cern.ch/record/2814347engUn Ahn, Sang Kim, JeongheonHan, HeejuneLee, Seung HeeYoon, HeejunThe first disk-based custodial storage for the ALICE experimentComputing and ComputersWe proposed a disk-based custodial storage as an alternative to tape for the ALICE experiment at CERN to preserve its raw data. The proposed storage system relies on Redundant Array of Independent Nodes (RAIN) layout – the implementation of erasure coding in the EOS storage suite, which is developed by CERN – for data protection and takes full advantage of high-density Just-Bunch-Of-Disks (JBOD) enclosures to maximize storage capacity as well as to achieve cost-effectiveness comparable to tape. The system we present provides 18 PB of total raw capacity from the 18 set of high-density JBOD enclosures attached to 9 EOS front-end servers. In order to balance between usable space and data protection, the system will stripe a file into 16 chunks on the 4-parity enabled RAIN layout configured on top of 18 containerized EOS FSTs. Although the reduction rate of available space increases up to 33:3% with this layout, the estimated annual data loss rate drops down to 8:6 × 10−5%. In this paper, we discuss the system architecture of the disk-based custodial storage, 4-parity RAIN layout, deployment automation, and the integration to the ALICE experiment in detail.oai:cds.cern.ch:28143472021 |
spellingShingle | Computing and Computers Un Ahn, Sang Kim, Jeongheon Han, Heejune Lee, Seung Hee Yoon, Heejun The first disk-based custodial storage for the ALICE experiment |
title | The first disk-based custodial storage for the ALICE experiment |
title_full | The first disk-based custodial storage for the ALICE experiment |
title_fullStr | The first disk-based custodial storage for the ALICE experiment |
title_full_unstemmed | The first disk-based custodial storage for the ALICE experiment |
title_short | The first disk-based custodial storage for the ALICE experiment |
title_sort | first disk-based custodial storage for the alice experiment |
topic | Computing and Computers |
url | https://dx.doi.org/10.1051/epjconf/202125102051 http://cds.cern.ch/record/2814347 |
work_keys_str_mv | AT unahnsang thefirstdiskbasedcustodialstorageforthealiceexperiment AT kimjeongheon thefirstdiskbasedcustodialstorageforthealiceexperiment AT hanheejune thefirstdiskbasedcustodialstorageforthealiceexperiment AT leeseunghee thefirstdiskbasedcustodialstorageforthealiceexperiment AT yoonheejun thefirstdiskbasedcustodialstorageforthealiceexperiment AT unahnsang firstdiskbasedcustodialstorageforthealiceexperiment AT kimjeongheon firstdiskbasedcustodialstorageforthealiceexperiment AT hanheejune firstdiskbasedcustodialstorageforthealiceexperiment AT leeseunghee firstdiskbasedcustodialstorageforthealiceexperiment AT yoonheejun firstdiskbasedcustodialstorageforthealiceexperiment |