Cargando…

SDNC-Repair: A Cooperative Data Repair Strategy Based on Erasure Code for Software-Defined Storage

Erasure-code-based storage systems suffer from problems such as long repair time and low I/O performance, resulting in high repair costs. For many years, researchers have focused on reducing the cost of repairing erasure-code-based storage systems. In this study, we discuss the demerits of node sele...

Descripción completa

Detalles Bibliográficos
Autores principales: Chen, Ningjiang, Liu, Weitao, Pu, Wenjuan, Liu, Yifei, Zhong, Qingwei
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10347193/
https://www.ncbi.nlm.nih.gov/pubmed/37447659
http://dx.doi.org/10.3390/s23135809
_version_ 1785073492030390272
author Chen, Ningjiang
Liu, Weitao
Pu, Wenjuan
Liu, Yifei
Zhong, Qingwei
author_facet Chen, Ningjiang
Liu, Weitao
Pu, Wenjuan
Liu, Yifei
Zhong, Qingwei
author_sort Chen, Ningjiang
collection PubMed
description Erasure-code-based storage systems suffer from problems such as long repair time and low I/O performance, resulting in high repair costs. For many years, researchers have focused on reducing the cost of repairing erasure-code-based storage systems. In this study, we discuss the demerits of node selecting, data transferring and data repair in erasure-code-based storage systems. Based on the network topology and node structure, we propose SDNC-Repair, a cooperative data repair strategy based on erasure code for SDS (Software Defined Storage), and describe its framework. Then, we propose a data source selection algorithm that senses the available network bandwidth between nodes and a data flow scheduling algorithm in SDNC-Repair. Additionally, we propose a data repair method based on node collaboration and data aggregation. Experiments illustrate that the proposed method has better repair performance under different data granularities. Compared to the conventional repair method, although the SDNC-Repair is more constrained by the cross-rack bandwidth, it improves system throughput effectively and significantly reduces data repair time in scenarios where multiple nodes fail and bandwidth is limited.
format Online
Article
Text
id pubmed-10347193
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-103471932023-07-15 SDNC-Repair: A Cooperative Data Repair Strategy Based on Erasure Code for Software-Defined Storage Chen, Ningjiang Liu, Weitao Pu, Wenjuan Liu, Yifei Zhong, Qingwei Sensors (Basel) Article Erasure-code-based storage systems suffer from problems such as long repair time and low I/O performance, resulting in high repair costs. For many years, researchers have focused on reducing the cost of repairing erasure-code-based storage systems. In this study, we discuss the demerits of node selecting, data transferring and data repair in erasure-code-based storage systems. Based on the network topology and node structure, we propose SDNC-Repair, a cooperative data repair strategy based on erasure code for SDS (Software Defined Storage), and describe its framework. Then, we propose a data source selection algorithm that senses the available network bandwidth between nodes and a data flow scheduling algorithm in SDNC-Repair. Additionally, we propose a data repair method based on node collaboration and data aggregation. Experiments illustrate that the proposed method has better repair performance under different data granularities. Compared to the conventional repair method, although the SDNC-Repair is more constrained by the cross-rack bandwidth, it improves system throughput effectively and significantly reduces data repair time in scenarios where multiple nodes fail and bandwidth is limited. MDPI 2023-06-22 /pmc/articles/PMC10347193/ /pubmed/37447659 http://dx.doi.org/10.3390/s23135809 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Chen, Ningjiang
Liu, Weitao
Pu, Wenjuan
Liu, Yifei
Zhong, Qingwei
SDNC-Repair: A Cooperative Data Repair Strategy Based on Erasure Code for Software-Defined Storage
title SDNC-Repair: A Cooperative Data Repair Strategy Based on Erasure Code for Software-Defined Storage
title_full SDNC-Repair: A Cooperative Data Repair Strategy Based on Erasure Code for Software-Defined Storage
title_fullStr SDNC-Repair: A Cooperative Data Repair Strategy Based on Erasure Code for Software-Defined Storage
title_full_unstemmed SDNC-Repair: A Cooperative Data Repair Strategy Based on Erasure Code for Software-Defined Storage
title_short SDNC-Repair: A Cooperative Data Repair Strategy Based on Erasure Code for Software-Defined Storage
title_sort sdnc-repair: a cooperative data repair strategy based on erasure code for software-defined storage
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10347193/
https://www.ncbi.nlm.nih.gov/pubmed/37447659
http://dx.doi.org/10.3390/s23135809
work_keys_str_mv AT chenningjiang sdncrepairacooperativedatarepairstrategybasedonerasurecodeforsoftwaredefinedstorage
AT liuweitao sdncrepairacooperativedatarepairstrategybasedonerasurecodeforsoftwaredefinedstorage
AT puwenjuan sdncrepairacooperativedatarepairstrategybasedonerasurecodeforsoftwaredefinedstorage
AT liuyifei sdncrepairacooperativedatarepairstrategybasedonerasurecodeforsoftwaredefinedstorage
AT zhongqingwei sdncrepairacooperativedatarepairstrategybasedonerasurecodeforsoftwaredefinedstorage