Cargando…
Blind Source Separation Method Based on Neural Network with Bias Term and Maximum Likelihood Estimation Criterion
Convergence speed and steady-state source separation performance are crucial for enable engineering applications of blind source separation methods. The modification of the loss function of the blind source separation algorithm and optimization of the algorithm to improve its performance from the pe...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7867157/ https://www.ncbi.nlm.nih.gov/pubmed/33535650 http://dx.doi.org/10.3390/s21030973 |
_version_ | 1783648239152529408 |
---|---|
author | Liu, Sheng Wang, Bangmin Zhang, Lanyong |
author_facet | Liu, Sheng Wang, Bangmin Zhang, Lanyong |
author_sort | Liu, Sheng |
collection | PubMed |
description | Convergence speed and steady-state source separation performance are crucial for enable engineering applications of blind source separation methods. The modification of the loss function of the blind source separation algorithm and optimization of the algorithm to improve its performance from the perspective of neural networks (NNs) is a novel concept. In this paper, a blind source separation method, combining the maximum likelihood estimation criterion and an NN with a bias term, is proposed. The method adds L2 regularization terms for weights and biases to the loss function to improve the steady-state performance and designs a novel optimization algorithm with a dual acceleration strategy to improve the convergence speed of the algorithm. The dual acceleration strategy of the proposed optimization algorithm smooths and speeds up the originally steep, slow gradient descent in the parameter space. Compared with competing algorithms, this strategy improves the convergence speed of the algorithm by four times and the steady-state performance index by 96%. In addition, to verify the source separation performance of the algorithm more comprehensively, the simulation data with prior knowledge and the measured data without prior knowledge are used to verify the separation performance. Both simulation results and validation results based on measured data indicate that the new algorithm not only has better convergence and steady-state performance than conventional algorithms, but it is also more suitable for engineering applications. |
format | Online Article Text |
id | pubmed-7867157 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-78671572021-02-07 Blind Source Separation Method Based on Neural Network with Bias Term and Maximum Likelihood Estimation Criterion Liu, Sheng Wang, Bangmin Zhang, Lanyong Sensors (Basel) Article Convergence speed and steady-state source separation performance are crucial for enable engineering applications of blind source separation methods. The modification of the loss function of the blind source separation algorithm and optimization of the algorithm to improve its performance from the perspective of neural networks (NNs) is a novel concept. In this paper, a blind source separation method, combining the maximum likelihood estimation criterion and an NN with a bias term, is proposed. The method adds L2 regularization terms for weights and biases to the loss function to improve the steady-state performance and designs a novel optimization algorithm with a dual acceleration strategy to improve the convergence speed of the algorithm. The dual acceleration strategy of the proposed optimization algorithm smooths and speeds up the originally steep, slow gradient descent in the parameter space. Compared with competing algorithms, this strategy improves the convergence speed of the algorithm by four times and the steady-state performance index by 96%. In addition, to verify the source separation performance of the algorithm more comprehensively, the simulation data with prior knowledge and the measured data without prior knowledge are used to verify the separation performance. Both simulation results and validation results based on measured data indicate that the new algorithm not only has better convergence and steady-state performance than conventional algorithms, but it is also more suitable for engineering applications. MDPI 2021-02-01 /pmc/articles/PMC7867157/ /pubmed/33535650 http://dx.doi.org/10.3390/s21030973 Text en © 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Liu, Sheng Wang, Bangmin Zhang, Lanyong Blind Source Separation Method Based on Neural Network with Bias Term and Maximum Likelihood Estimation Criterion |
title | Blind Source Separation Method Based on Neural Network with Bias Term and Maximum Likelihood Estimation Criterion |
title_full | Blind Source Separation Method Based on Neural Network with Bias Term and Maximum Likelihood Estimation Criterion |
title_fullStr | Blind Source Separation Method Based on Neural Network with Bias Term and Maximum Likelihood Estimation Criterion |
title_full_unstemmed | Blind Source Separation Method Based on Neural Network with Bias Term and Maximum Likelihood Estimation Criterion |
title_short | Blind Source Separation Method Based on Neural Network with Bias Term and Maximum Likelihood Estimation Criterion |
title_sort | blind source separation method based on neural network with bias term and maximum likelihood estimation criterion |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7867157/ https://www.ncbi.nlm.nih.gov/pubmed/33535650 http://dx.doi.org/10.3390/s21030973 |
work_keys_str_mv | AT liusheng blindsourceseparationmethodbasedonneuralnetworkwithbiastermandmaximumlikelihoodestimationcriterion AT wangbangmin blindsourceseparationmethodbasedonneuralnetworkwithbiastermandmaximumlikelihoodestimationcriterion AT zhanglanyong blindsourceseparationmethodbasedonneuralnetworkwithbiastermandmaximumlikelihoodestimationcriterion |