Cargando…

The first disk-based custodial storage for the ALICE experiment

We proposed a disk-based custodial storage as an alternative to tape for the ALICE experiment at CERN to preserve its raw data. The proposed storage system relies on Redundant Array of Independent Nodes (RAIN) layout – the implementation of erasure coding in the EOS storage suite, which is developed...

Descripción completa

Detalles Bibliográficos
Autores principales: Un Ahn, Sang , Kim, Jeongheon, Han, Heejune, Lee, Seung Hee, Yoon, Heejun
Lenguaje:eng
Publicado: 2021
Materias:
Acceso en línea:https://dx.doi.org/10.1051/epjconf/202125102051
http://cds.cern.ch/record/2814347
_version_ 1780973438904565760
author Un Ahn, Sang 
Kim, Jeongheon
Han, Heejune
Lee, Seung Hee
Yoon, Heejun
author_facet Un Ahn, Sang 
Kim, Jeongheon
Han, Heejune
Lee, Seung Hee
Yoon, Heejun
author_sort Un Ahn, Sang 
collection CERN
description We proposed a disk-based custodial storage as an alternative to tape for the ALICE experiment at CERN to preserve its raw data. The proposed storage system relies on Redundant Array of Independent Nodes (RAIN) layout – the implementation of erasure coding in the EOS storage suite, which is developed by CERN – for data protection and takes full advantage of high-density Just-Bunch-Of-Disks (JBOD) enclosures to maximize storage capacity as well as to achieve cost-effectiveness comparable to tape. The system we present provides 18 PB of total raw capacity from the 18 set of high-density JBOD enclosures attached to 9 EOS front-end servers. In order to balance between usable space and data protection, the system will stripe a file into 16 chunks on the 4-parity enabled RAIN layout configured on top of 18 containerized EOS FSTs. Although the reduction rate of available space increases up to 33:3% with this layout, the estimated annual data loss rate drops down to 8:6 × 10−5%. In this paper, we discuss the system architecture of the disk-based custodial storage, 4-parity RAIN layout, deployment automation, and the integration to the ALICE experiment in detail.
id cern-2814347
institution Organización Europea para la Investigación Nuclear
language eng
publishDate 2021
record_format invenio
spelling cern-28143472022-08-17T19:58:26Zdoi:10.1051/epjconf/202125102051http://cds.cern.ch/record/2814347engUn Ahn, Sang Kim, JeongheonHan, HeejuneLee, Seung HeeYoon, HeejunThe first disk-based custodial storage for the ALICE experimentComputing and ComputersWe proposed a disk-based custodial storage as an alternative to tape for the ALICE experiment at CERN to preserve its raw data. The proposed storage system relies on Redundant Array of Independent Nodes (RAIN) layout – the implementation of erasure coding in the EOS storage suite, which is developed by CERN – for data protection and takes full advantage of high-density Just-Bunch-Of-Disks (JBOD) enclosures to maximize storage capacity as well as to achieve cost-effectiveness comparable to tape. The system we present provides 18 PB of total raw capacity from the 18 set of high-density JBOD enclosures attached to 9 EOS front-end servers. In order to balance between usable space and data protection, the system will stripe a file into 16 chunks on the 4-parity enabled RAIN layout configured on top of 18 containerized EOS FSTs. Although the reduction rate of available space increases up to 33:3% with this layout, the estimated annual data loss rate drops down to 8:6 × 10−5%. In this paper, we discuss the system architecture of the disk-based custodial storage, 4-parity RAIN layout, deployment automation, and the integration to the ALICE experiment in detail.oai:cds.cern.ch:28143472021
spellingShingle Computing and Computers
Un Ahn, Sang 
Kim, Jeongheon
Han, Heejune
Lee, Seung Hee
Yoon, Heejun
The first disk-based custodial storage for the ALICE experiment
title The first disk-based custodial storage for the ALICE experiment
title_full The first disk-based custodial storage for the ALICE experiment
title_fullStr The first disk-based custodial storage for the ALICE experiment
title_full_unstemmed The first disk-based custodial storage for the ALICE experiment
title_short The first disk-based custodial storage for the ALICE experiment
title_sort first disk-based custodial storage for the alice experiment
topic Computing and Computers
url https://dx.doi.org/10.1051/epjconf/202125102051
http://cds.cern.ch/record/2814347
work_keys_str_mv AT unahnsang thefirstdiskbasedcustodialstorageforthealiceexperiment
AT kimjeongheon thefirstdiskbasedcustodialstorageforthealiceexperiment
AT hanheejune thefirstdiskbasedcustodialstorageforthealiceexperiment
AT leeseunghee thefirstdiskbasedcustodialstorageforthealiceexperiment
AT yoonheejun thefirstdiskbasedcustodialstorageforthealiceexperiment
AT unahnsang firstdiskbasedcustodialstorageforthealiceexperiment
AT kimjeongheon firstdiskbasedcustodialstorageforthealiceexperiment
AT hanheejune firstdiskbasedcustodialstorageforthealiceexperiment
AT leeseunghee firstdiskbasedcustodialstorageforthealiceexperiment
AT yoonheejun firstdiskbasedcustodialstorageforthealiceexperiment