Cargando…
SDNC-Repair: A Cooperative Data Repair Strategy Based on Erasure Code for Software-Defined Storage
Erasure-code-based storage systems suffer from problems such as long repair time and low I/O performance, resulting in high repair costs. For many years, researchers have focused on reducing the cost of repairing erasure-code-based storage systems. In this study, we discuss the demerits of node sele...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10347193/ https://www.ncbi.nlm.nih.gov/pubmed/37447659 http://dx.doi.org/10.3390/s23135809 |
_version_ | 1785073492030390272 |
---|---|
author | Chen, Ningjiang Liu, Weitao Pu, Wenjuan Liu, Yifei Zhong, Qingwei |
author_facet | Chen, Ningjiang Liu, Weitao Pu, Wenjuan Liu, Yifei Zhong, Qingwei |
author_sort | Chen, Ningjiang |
collection | PubMed |
description | Erasure-code-based storage systems suffer from problems such as long repair time and low I/O performance, resulting in high repair costs. For many years, researchers have focused on reducing the cost of repairing erasure-code-based storage systems. In this study, we discuss the demerits of node selecting, data transferring and data repair in erasure-code-based storage systems. Based on the network topology and node structure, we propose SDNC-Repair, a cooperative data repair strategy based on erasure code for SDS (Software Defined Storage), and describe its framework. Then, we propose a data source selection algorithm that senses the available network bandwidth between nodes and a data flow scheduling algorithm in SDNC-Repair. Additionally, we propose a data repair method based on node collaboration and data aggregation. Experiments illustrate that the proposed method has better repair performance under different data granularities. Compared to the conventional repair method, although the SDNC-Repair is more constrained by the cross-rack bandwidth, it improves system throughput effectively and significantly reduces data repair time in scenarios where multiple nodes fail and bandwidth is limited. |
format | Online Article Text |
id | pubmed-10347193 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-103471932023-07-15 SDNC-Repair: A Cooperative Data Repair Strategy Based on Erasure Code for Software-Defined Storage Chen, Ningjiang Liu, Weitao Pu, Wenjuan Liu, Yifei Zhong, Qingwei Sensors (Basel) Article Erasure-code-based storage systems suffer from problems such as long repair time and low I/O performance, resulting in high repair costs. For many years, researchers have focused on reducing the cost of repairing erasure-code-based storage systems. In this study, we discuss the demerits of node selecting, data transferring and data repair in erasure-code-based storage systems. Based on the network topology and node structure, we propose SDNC-Repair, a cooperative data repair strategy based on erasure code for SDS (Software Defined Storage), and describe its framework. Then, we propose a data source selection algorithm that senses the available network bandwidth between nodes and a data flow scheduling algorithm in SDNC-Repair. Additionally, we propose a data repair method based on node collaboration and data aggregation. Experiments illustrate that the proposed method has better repair performance under different data granularities. Compared to the conventional repair method, although the SDNC-Repair is more constrained by the cross-rack bandwidth, it improves system throughput effectively and significantly reduces data repair time in scenarios where multiple nodes fail and bandwidth is limited. MDPI 2023-06-22 /pmc/articles/PMC10347193/ /pubmed/37447659 http://dx.doi.org/10.3390/s23135809 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Chen, Ningjiang Liu, Weitao Pu, Wenjuan Liu, Yifei Zhong, Qingwei SDNC-Repair: A Cooperative Data Repair Strategy Based on Erasure Code for Software-Defined Storage |
title | SDNC-Repair: A Cooperative Data Repair Strategy Based on Erasure Code for Software-Defined Storage |
title_full | SDNC-Repair: A Cooperative Data Repair Strategy Based on Erasure Code for Software-Defined Storage |
title_fullStr | SDNC-Repair: A Cooperative Data Repair Strategy Based on Erasure Code for Software-Defined Storage |
title_full_unstemmed | SDNC-Repair: A Cooperative Data Repair Strategy Based on Erasure Code for Software-Defined Storage |
title_short | SDNC-Repair: A Cooperative Data Repair Strategy Based on Erasure Code for Software-Defined Storage |
title_sort | sdnc-repair: a cooperative data repair strategy based on erasure code for software-defined storage |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10347193/ https://www.ncbi.nlm.nih.gov/pubmed/37447659 http://dx.doi.org/10.3390/s23135809 |
work_keys_str_mv | AT chenningjiang sdncrepairacooperativedatarepairstrategybasedonerasurecodeforsoftwaredefinedstorage AT liuweitao sdncrepairacooperativedatarepairstrategybasedonerasurecodeforsoftwaredefinedstorage AT puwenjuan sdncrepairacooperativedatarepairstrategybasedonerasurecodeforsoftwaredefinedstorage AT liuyifei sdncrepairacooperativedatarepairstrategybasedonerasurecodeforsoftwaredefinedstorage AT zhongqingwei sdncrepairacooperativedatarepairstrategybasedonerasurecodeforsoftwaredefinedstorage |