Cargando…

Robust optimization of convolutional neural networks with a uniform experiment design method: a case of phonocardiogram testing in patients with heart diseases

BACKGROUND: Heart sound measurement is crucial for analyzing and diagnosing patients with heart diseases. This study employed phonocardiogram signals as the input signal for heart disease analysis due to the accessibility of the respective method. This study referenced preprocessing techniques propo...

Descripción completa

Detalles Bibliográficos
Autores principales: Ho, Wen-Hsien, Huang, Tian-Hsiang, Yang, Po-Yuan, Chou, Jyh-Horng, Qu, Jin-Yi, Chang, Po-Chih, Chou, Fu-I., Tsai, Jinn-Tsong
Formato: Online Artículo Texto
Lenguaje:English
Publicado: BioMed Central 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8576886/
https://www.ncbi.nlm.nih.gov/pubmed/34749632
http://dx.doi.org/10.1186/s12859-021-04032-8
_version_ 1784595968254017536
author Ho, Wen-Hsien
Huang, Tian-Hsiang
Yang, Po-Yuan
Chou, Jyh-Horng
Qu, Jin-Yi
Chang, Po-Chih
Chou, Fu-I.
Tsai, Jinn-Tsong
author_facet Ho, Wen-Hsien
Huang, Tian-Hsiang
Yang, Po-Yuan
Chou, Jyh-Horng
Qu, Jin-Yi
Chang, Po-Chih
Chou, Fu-I.
Tsai, Jinn-Tsong
author_sort Ho, Wen-Hsien
collection PubMed
description BACKGROUND: Heart sound measurement is crucial for analyzing and diagnosing patients with heart diseases. This study employed phonocardiogram signals as the input signal for heart disease analysis due to the accessibility of the respective method. This study referenced preprocessing techniques proposed by other researchers for the conversion of phonocardiogram signals into characteristic images composed using frequency subband. Image recognition was then conducted through the use of convolutional neural networks (CNNs), in order to classify the predicted of phonocardiogram signals as normal or abnormal. However, CNN requires the tuning of multiple hyperparameters, which entails an optimization problem for the hyperparameters in the model. To maximize CNN robustness, the uniform experiment design method and a science-based methodical experiment design were used to optimize CNN hyperparameters in this study. RESULTS: An artificial intelligence prediction model was constructed using CNN, and the uniform experiment design method was proposed to acquire hyperparameters for optimal CNN robustness. The results indicate Filters ([Formula: see text] ), Stride ([Formula: see text] ), Activation functions ([Formula: see text] ), and Dropout ([Formula: see text] ) to be significant factors considerably influencing the ability of CNN to distinguish among heart sound states. Finally, the confirmation experiment was conducted, and the hyperparameter combination for optimal model robustness was Filters ([Formula: see text] ) = 32, Kernel Size ([Formula: see text] = 3 × 3, Stride ([Formula: see text] ) = (1,1), Padding ([Formula: see text] as same, Optimizer ([Formula: see text] as the stochastic gradient descent, Activation functions ([Formula: see text] ) as relu, and Dropout ([Formula: see text] ) = 0.544. With this combination of parameters, the model had an average prediction accuracy rate of 0.787 and standard deviation of 0. CONCLUSION: In this study, phonocardiogram signals were used for the early prediction of heart diseases. The science-based and methodical uniform experiment design was used for the optimization of CNN hyperparameters to construct a CNN with optimal robustness. The results revealed that the constructed model exhibited robustness and an acceptable accuracy rate. Other literature has failed to address hyperparameter optimization problems in CNN; a method is subsequently proposed for robust CNN optimization, thereby solving this problem.
format Online
Article
Text
id pubmed-8576886
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher BioMed Central
record_format MEDLINE/PubMed
spelling pubmed-85768862021-11-10 Robust optimization of convolutional neural networks with a uniform experiment design method: a case of phonocardiogram testing in patients with heart diseases Ho, Wen-Hsien Huang, Tian-Hsiang Yang, Po-Yuan Chou, Jyh-Horng Qu, Jin-Yi Chang, Po-Chih Chou, Fu-I. Tsai, Jinn-Tsong BMC Bioinformatics Research BACKGROUND: Heart sound measurement is crucial for analyzing and diagnosing patients with heart diseases. This study employed phonocardiogram signals as the input signal for heart disease analysis due to the accessibility of the respective method. This study referenced preprocessing techniques proposed by other researchers for the conversion of phonocardiogram signals into characteristic images composed using frequency subband. Image recognition was then conducted through the use of convolutional neural networks (CNNs), in order to classify the predicted of phonocardiogram signals as normal or abnormal. However, CNN requires the tuning of multiple hyperparameters, which entails an optimization problem for the hyperparameters in the model. To maximize CNN robustness, the uniform experiment design method and a science-based methodical experiment design were used to optimize CNN hyperparameters in this study. RESULTS: An artificial intelligence prediction model was constructed using CNN, and the uniform experiment design method was proposed to acquire hyperparameters for optimal CNN robustness. The results indicate Filters ([Formula: see text] ), Stride ([Formula: see text] ), Activation functions ([Formula: see text] ), and Dropout ([Formula: see text] ) to be significant factors considerably influencing the ability of CNN to distinguish among heart sound states. Finally, the confirmation experiment was conducted, and the hyperparameter combination for optimal model robustness was Filters ([Formula: see text] ) = 32, Kernel Size ([Formula: see text] = 3 × 3, Stride ([Formula: see text] ) = (1,1), Padding ([Formula: see text] as same, Optimizer ([Formula: see text] as the stochastic gradient descent, Activation functions ([Formula: see text] ) as relu, and Dropout ([Formula: see text] ) = 0.544. With this combination of parameters, the model had an average prediction accuracy rate of 0.787 and standard deviation of 0. CONCLUSION: In this study, phonocardiogram signals were used for the early prediction of heart diseases. The science-based and methodical uniform experiment design was used for the optimization of CNN hyperparameters to construct a CNN with optimal robustness. The results revealed that the constructed model exhibited robustness and an acceptable accuracy rate. Other literature has failed to address hyperparameter optimization problems in CNN; a method is subsequently proposed for robust CNN optimization, thereby solving this problem. BioMed Central 2021-11-08 /pmc/articles/PMC8576886/ /pubmed/34749632 http://dx.doi.org/10.1186/s12859-021-04032-8 Text en © The Author(s) 2021 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/ (https://creativecommons.org/publicdomain/zero/1.0/) ) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
spellingShingle Research
Ho, Wen-Hsien
Huang, Tian-Hsiang
Yang, Po-Yuan
Chou, Jyh-Horng
Qu, Jin-Yi
Chang, Po-Chih
Chou, Fu-I.
Tsai, Jinn-Tsong
Robust optimization of convolutional neural networks with a uniform experiment design method: a case of phonocardiogram testing in patients with heart diseases
title Robust optimization of convolutional neural networks with a uniform experiment design method: a case of phonocardiogram testing in patients with heart diseases
title_full Robust optimization of convolutional neural networks with a uniform experiment design method: a case of phonocardiogram testing in patients with heart diseases
title_fullStr Robust optimization of convolutional neural networks with a uniform experiment design method: a case of phonocardiogram testing in patients with heart diseases
title_full_unstemmed Robust optimization of convolutional neural networks with a uniform experiment design method: a case of phonocardiogram testing in patients with heart diseases
title_short Robust optimization of convolutional neural networks with a uniform experiment design method: a case of phonocardiogram testing in patients with heart diseases
title_sort robust optimization of convolutional neural networks with a uniform experiment design method: a case of phonocardiogram testing in patients with heart diseases
topic Research
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8576886/
https://www.ncbi.nlm.nih.gov/pubmed/34749632
http://dx.doi.org/10.1186/s12859-021-04032-8
work_keys_str_mv AT howenhsien robustoptimizationofconvolutionalneuralnetworkswithauniformexperimentdesignmethodacaseofphonocardiogramtestinginpatientswithheartdiseases
AT huangtianhsiang robustoptimizationofconvolutionalneuralnetworkswithauniformexperimentdesignmethodacaseofphonocardiogramtestinginpatientswithheartdiseases
AT yangpoyuan robustoptimizationofconvolutionalneuralnetworkswithauniformexperimentdesignmethodacaseofphonocardiogramtestinginpatientswithheartdiseases
AT choujyhhorng robustoptimizationofconvolutionalneuralnetworkswithauniformexperimentdesignmethodacaseofphonocardiogramtestinginpatientswithheartdiseases
AT qujinyi robustoptimizationofconvolutionalneuralnetworkswithauniformexperimentdesignmethodacaseofphonocardiogramtestinginpatientswithheartdiseases
AT changpochih robustoptimizationofconvolutionalneuralnetworkswithauniformexperimentdesignmethodacaseofphonocardiogramtestinginpatientswithheartdiseases
AT choufui robustoptimizationofconvolutionalneuralnetworkswithauniformexperimentdesignmethodacaseofphonocardiogramtestinginpatientswithheartdiseases
AT tsaijinntsong robustoptimizationofconvolutionalneuralnetworkswithauniformexperimentdesignmethodacaseofphonocardiogramtestinginpatientswithheartdiseases