Cargando…

Blind Source Separation Method Based on Neural Network with Bias Term and Maximum Likelihood Estimation Criterion

Convergence speed and steady-state source separation performance are crucial for enable engineering applications of blind source separation methods. The modification of the loss function of the blind source separation algorithm and optimization of the algorithm to improve its performance from the pe...

Descripción completa

Detalles Bibliográficos
Autores principales: Liu, Sheng, Wang, Bangmin, Zhang, Lanyong
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7867157/
https://www.ncbi.nlm.nih.gov/pubmed/33535650
http://dx.doi.org/10.3390/s21030973
_version_ 1783648239152529408
author Liu, Sheng
Wang, Bangmin
Zhang, Lanyong
author_facet Liu, Sheng
Wang, Bangmin
Zhang, Lanyong
author_sort Liu, Sheng
collection PubMed
description Convergence speed and steady-state source separation performance are crucial for enable engineering applications of blind source separation methods. The modification of the loss function of the blind source separation algorithm and optimization of the algorithm to improve its performance from the perspective of neural networks (NNs) is a novel concept. In this paper, a blind source separation method, combining the maximum likelihood estimation criterion and an NN with a bias term, is proposed. The method adds L2 regularization terms for weights and biases to the loss function to improve the steady-state performance and designs a novel optimization algorithm with a dual acceleration strategy to improve the convergence speed of the algorithm. The dual acceleration strategy of the proposed optimization algorithm smooths and speeds up the originally steep, slow gradient descent in the parameter space. Compared with competing algorithms, this strategy improves the convergence speed of the algorithm by four times and the steady-state performance index by 96%. In addition, to verify the source separation performance of the algorithm more comprehensively, the simulation data with prior knowledge and the measured data without prior knowledge are used to verify the separation performance. Both simulation results and validation results based on measured data indicate that the new algorithm not only has better convergence and steady-state performance than conventional algorithms, but it is also more suitable for engineering applications.
format Online
Article
Text
id pubmed-7867157
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-78671572021-02-07 Blind Source Separation Method Based on Neural Network with Bias Term and Maximum Likelihood Estimation Criterion Liu, Sheng Wang, Bangmin Zhang, Lanyong Sensors (Basel) Article Convergence speed and steady-state source separation performance are crucial for enable engineering applications of blind source separation methods. The modification of the loss function of the blind source separation algorithm and optimization of the algorithm to improve its performance from the perspective of neural networks (NNs) is a novel concept. In this paper, a blind source separation method, combining the maximum likelihood estimation criterion and an NN with a bias term, is proposed. The method adds L2 regularization terms for weights and biases to the loss function to improve the steady-state performance and designs a novel optimization algorithm with a dual acceleration strategy to improve the convergence speed of the algorithm. The dual acceleration strategy of the proposed optimization algorithm smooths and speeds up the originally steep, slow gradient descent in the parameter space. Compared with competing algorithms, this strategy improves the convergence speed of the algorithm by four times and the steady-state performance index by 96%. In addition, to verify the source separation performance of the algorithm more comprehensively, the simulation data with prior knowledge and the measured data without prior knowledge are used to verify the separation performance. Both simulation results and validation results based on measured data indicate that the new algorithm not only has better convergence and steady-state performance than conventional algorithms, but it is also more suitable for engineering applications. MDPI 2021-02-01 /pmc/articles/PMC7867157/ /pubmed/33535650 http://dx.doi.org/10.3390/s21030973 Text en © 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Liu, Sheng
Wang, Bangmin
Zhang, Lanyong
Blind Source Separation Method Based on Neural Network with Bias Term and Maximum Likelihood Estimation Criterion
title Blind Source Separation Method Based on Neural Network with Bias Term and Maximum Likelihood Estimation Criterion
title_full Blind Source Separation Method Based on Neural Network with Bias Term and Maximum Likelihood Estimation Criterion
title_fullStr Blind Source Separation Method Based on Neural Network with Bias Term and Maximum Likelihood Estimation Criterion
title_full_unstemmed Blind Source Separation Method Based on Neural Network with Bias Term and Maximum Likelihood Estimation Criterion
title_short Blind Source Separation Method Based on Neural Network with Bias Term and Maximum Likelihood Estimation Criterion
title_sort blind source separation method based on neural network with bias term and maximum likelihood estimation criterion
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7867157/
https://www.ncbi.nlm.nih.gov/pubmed/33535650
http://dx.doi.org/10.3390/s21030973
work_keys_str_mv AT liusheng blindsourceseparationmethodbasedonneuralnetworkwithbiastermandmaximumlikelihoodestimationcriterion
AT wangbangmin blindsourceseparationmethodbasedonneuralnetworkwithbiastermandmaximumlikelihoodestimationcriterion
AT zhanglanyong blindsourceseparationmethodbasedonneuralnetworkwithbiastermandmaximumlikelihoodestimationcriterion