Cargando…

Reliable Service Function Chain Deployment Method Based on Deep Reinforcement Learning

Network function virtualization (NFV) is a key technology to decouple hardware device and software function. Several virtual network functions (VNFs) combine into a function sequence in a certain order, that is defined as service function chain (SFC). A significant challenge is guaranteeing reliabil...

Descripción completa

Detalles Bibliográficos
Autores principales: Qu, Hua, Wang, Ke, Zhao, Jihong
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8069682/
https://www.ncbi.nlm.nih.gov/pubmed/33924460
http://dx.doi.org/10.3390/s21082733
_version_ 1783683294357880832
author Qu, Hua
Wang, Ke
Zhao, Jihong
author_facet Qu, Hua
Wang, Ke
Zhao, Jihong
author_sort Qu, Hua
collection PubMed
description Network function virtualization (NFV) is a key technology to decouple hardware device and software function. Several virtual network functions (VNFs) combine into a function sequence in a certain order, that is defined as service function chain (SFC). A significant challenge is guaranteeing reliability. First, deployment server is selected to place VNF, then, backup server is determined to place the VNF as a backup which is running when deployment server is failed. Moreover, how to determine the accurate locations dynamically with machine learning is challenging. This paper focuses on resource requirements of SFC to measure its priority meanwhile calculates node priority by current resource capacity and node degree, then, a novel priority-awareness deep reinforcement learning (PA-DRL) algorithm is proposed to implement reliable SFC dynamically. PA-DRL determines the backup scheme of each VNF, then, the model jointly utilizes delay, load balancing of network as feedback factors to optimize the quality of service. In the experimental results, resource efficient utilization, survival rate, and load balancing of PA-DRL were improved by 36.7%, 35.1%, and 78.9% on average compared with benchmark algorithm respectively, average delay was reduced by 14.9%. Therefore, PA-DRL can effectively improve reliability and optimization targets compared with other benchmark methods.
format Online
Article
Text
id pubmed-8069682
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-80696822021-04-26 Reliable Service Function Chain Deployment Method Based on Deep Reinforcement Learning Qu, Hua Wang, Ke Zhao, Jihong Sensors (Basel) Article Network function virtualization (NFV) is a key technology to decouple hardware device and software function. Several virtual network functions (VNFs) combine into a function sequence in a certain order, that is defined as service function chain (SFC). A significant challenge is guaranteeing reliability. First, deployment server is selected to place VNF, then, backup server is determined to place the VNF as a backup which is running when deployment server is failed. Moreover, how to determine the accurate locations dynamically with machine learning is challenging. This paper focuses on resource requirements of SFC to measure its priority meanwhile calculates node priority by current resource capacity and node degree, then, a novel priority-awareness deep reinforcement learning (PA-DRL) algorithm is proposed to implement reliable SFC dynamically. PA-DRL determines the backup scheme of each VNF, then, the model jointly utilizes delay, load balancing of network as feedback factors to optimize the quality of service. In the experimental results, resource efficient utilization, survival rate, and load balancing of PA-DRL were improved by 36.7%, 35.1%, and 78.9% on average compared with benchmark algorithm respectively, average delay was reduced by 14.9%. Therefore, PA-DRL can effectively improve reliability and optimization targets compared with other benchmark methods. MDPI 2021-04-13 /pmc/articles/PMC8069682/ /pubmed/33924460 http://dx.doi.org/10.3390/s21082733 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) ).
spellingShingle Article
Qu, Hua
Wang, Ke
Zhao, Jihong
Reliable Service Function Chain Deployment Method Based on Deep Reinforcement Learning
title Reliable Service Function Chain Deployment Method Based on Deep Reinforcement Learning
title_full Reliable Service Function Chain Deployment Method Based on Deep Reinforcement Learning
title_fullStr Reliable Service Function Chain Deployment Method Based on Deep Reinforcement Learning
title_full_unstemmed Reliable Service Function Chain Deployment Method Based on Deep Reinforcement Learning
title_short Reliable Service Function Chain Deployment Method Based on Deep Reinforcement Learning
title_sort reliable service function chain deployment method based on deep reinforcement learning
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8069682/
https://www.ncbi.nlm.nih.gov/pubmed/33924460
http://dx.doi.org/10.3390/s21082733
work_keys_str_mv AT quhua reliableservicefunctionchaindeploymentmethodbasedondeepreinforcementlearning
AT wangke reliableservicefunctionchaindeploymentmethodbasedondeepreinforcementlearning
AT zhaojihong reliableservicefunctionchaindeploymentmethodbasedondeepreinforcementlearning