Cargando…
Robust optimization of convolutional neural networks with a uniform experiment design method: a case of phonocardiogram testing in patients with heart diseases
BACKGROUND: Heart sound measurement is crucial for analyzing and diagnosing patients with heart diseases. This study employed phonocardiogram signals as the input signal for heart disease analysis due to the accessibility of the respective method. This study referenced preprocessing techniques propo...
Autores principales: | , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
BioMed Central
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8576886/ https://www.ncbi.nlm.nih.gov/pubmed/34749632 http://dx.doi.org/10.1186/s12859-021-04032-8 |
_version_ | 1784595968254017536 |
---|---|
author | Ho, Wen-Hsien Huang, Tian-Hsiang Yang, Po-Yuan Chou, Jyh-Horng Qu, Jin-Yi Chang, Po-Chih Chou, Fu-I. Tsai, Jinn-Tsong |
author_facet | Ho, Wen-Hsien Huang, Tian-Hsiang Yang, Po-Yuan Chou, Jyh-Horng Qu, Jin-Yi Chang, Po-Chih Chou, Fu-I. Tsai, Jinn-Tsong |
author_sort | Ho, Wen-Hsien |
collection | PubMed |
description | BACKGROUND: Heart sound measurement is crucial for analyzing and diagnosing patients with heart diseases. This study employed phonocardiogram signals as the input signal for heart disease analysis due to the accessibility of the respective method. This study referenced preprocessing techniques proposed by other researchers for the conversion of phonocardiogram signals into characteristic images composed using frequency subband. Image recognition was then conducted through the use of convolutional neural networks (CNNs), in order to classify the predicted of phonocardiogram signals as normal or abnormal. However, CNN requires the tuning of multiple hyperparameters, which entails an optimization problem for the hyperparameters in the model. To maximize CNN robustness, the uniform experiment design method and a science-based methodical experiment design were used to optimize CNN hyperparameters in this study. RESULTS: An artificial intelligence prediction model was constructed using CNN, and the uniform experiment design method was proposed to acquire hyperparameters for optimal CNN robustness. The results indicate Filters ([Formula: see text] ), Stride ([Formula: see text] ), Activation functions ([Formula: see text] ), and Dropout ([Formula: see text] ) to be significant factors considerably influencing the ability of CNN to distinguish among heart sound states. Finally, the confirmation experiment was conducted, and the hyperparameter combination for optimal model robustness was Filters ([Formula: see text] ) = 32, Kernel Size ([Formula: see text] = 3 × 3, Stride ([Formula: see text] ) = (1,1), Padding ([Formula: see text] as same, Optimizer ([Formula: see text] as the stochastic gradient descent, Activation functions ([Formula: see text] ) as relu, and Dropout ([Formula: see text] ) = 0.544. With this combination of parameters, the model had an average prediction accuracy rate of 0.787 and standard deviation of 0. CONCLUSION: In this study, phonocardiogram signals were used for the early prediction of heart diseases. The science-based and methodical uniform experiment design was used for the optimization of CNN hyperparameters to construct a CNN with optimal robustness. The results revealed that the constructed model exhibited robustness and an acceptable accuracy rate. Other literature has failed to address hyperparameter optimization problems in CNN; a method is subsequently proposed for robust CNN optimization, thereby solving this problem. |
format | Online Article Text |
id | pubmed-8576886 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | BioMed Central |
record_format | MEDLINE/PubMed |
spelling | pubmed-85768862021-11-10 Robust optimization of convolutional neural networks with a uniform experiment design method: a case of phonocardiogram testing in patients with heart diseases Ho, Wen-Hsien Huang, Tian-Hsiang Yang, Po-Yuan Chou, Jyh-Horng Qu, Jin-Yi Chang, Po-Chih Chou, Fu-I. Tsai, Jinn-Tsong BMC Bioinformatics Research BACKGROUND: Heart sound measurement is crucial for analyzing and diagnosing patients with heart diseases. This study employed phonocardiogram signals as the input signal for heart disease analysis due to the accessibility of the respective method. This study referenced preprocessing techniques proposed by other researchers for the conversion of phonocardiogram signals into characteristic images composed using frequency subband. Image recognition was then conducted through the use of convolutional neural networks (CNNs), in order to classify the predicted of phonocardiogram signals as normal or abnormal. However, CNN requires the tuning of multiple hyperparameters, which entails an optimization problem for the hyperparameters in the model. To maximize CNN robustness, the uniform experiment design method and a science-based methodical experiment design were used to optimize CNN hyperparameters in this study. RESULTS: An artificial intelligence prediction model was constructed using CNN, and the uniform experiment design method was proposed to acquire hyperparameters for optimal CNN robustness. The results indicate Filters ([Formula: see text] ), Stride ([Formula: see text] ), Activation functions ([Formula: see text] ), and Dropout ([Formula: see text] ) to be significant factors considerably influencing the ability of CNN to distinguish among heart sound states. Finally, the confirmation experiment was conducted, and the hyperparameter combination for optimal model robustness was Filters ([Formula: see text] ) = 32, Kernel Size ([Formula: see text] = 3 × 3, Stride ([Formula: see text] ) = (1,1), Padding ([Formula: see text] as same, Optimizer ([Formula: see text] as the stochastic gradient descent, Activation functions ([Formula: see text] ) as relu, and Dropout ([Formula: see text] ) = 0.544. With this combination of parameters, the model had an average prediction accuracy rate of 0.787 and standard deviation of 0. CONCLUSION: In this study, phonocardiogram signals were used for the early prediction of heart diseases. The science-based and methodical uniform experiment design was used for the optimization of CNN hyperparameters to construct a CNN with optimal robustness. The results revealed that the constructed model exhibited robustness and an acceptable accuracy rate. Other literature has failed to address hyperparameter optimization problems in CNN; a method is subsequently proposed for robust CNN optimization, thereby solving this problem. BioMed Central 2021-11-08 /pmc/articles/PMC8576886/ /pubmed/34749632 http://dx.doi.org/10.1186/s12859-021-04032-8 Text en © The Author(s) 2021 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/ (https://creativecommons.org/publicdomain/zero/1.0/) ) applies to the data made available in this article, unless otherwise stated in a credit line to the data. |
spellingShingle | Research Ho, Wen-Hsien Huang, Tian-Hsiang Yang, Po-Yuan Chou, Jyh-Horng Qu, Jin-Yi Chang, Po-Chih Chou, Fu-I. Tsai, Jinn-Tsong Robust optimization of convolutional neural networks with a uniform experiment design method: a case of phonocardiogram testing in patients with heart diseases |
title | Robust optimization of convolutional neural networks with a uniform experiment design method: a case of phonocardiogram testing in patients with heart diseases |
title_full | Robust optimization of convolutional neural networks with a uniform experiment design method: a case of phonocardiogram testing in patients with heart diseases |
title_fullStr | Robust optimization of convolutional neural networks with a uniform experiment design method: a case of phonocardiogram testing in patients with heart diseases |
title_full_unstemmed | Robust optimization of convolutional neural networks with a uniform experiment design method: a case of phonocardiogram testing in patients with heart diseases |
title_short | Robust optimization of convolutional neural networks with a uniform experiment design method: a case of phonocardiogram testing in patients with heart diseases |
title_sort | robust optimization of convolutional neural networks with a uniform experiment design method: a case of phonocardiogram testing in patients with heart diseases |
topic | Research |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8576886/ https://www.ncbi.nlm.nih.gov/pubmed/34749632 http://dx.doi.org/10.1186/s12859-021-04032-8 |
work_keys_str_mv | AT howenhsien robustoptimizationofconvolutionalneuralnetworkswithauniformexperimentdesignmethodacaseofphonocardiogramtestinginpatientswithheartdiseases AT huangtianhsiang robustoptimizationofconvolutionalneuralnetworkswithauniformexperimentdesignmethodacaseofphonocardiogramtestinginpatientswithheartdiseases AT yangpoyuan robustoptimizationofconvolutionalneuralnetworkswithauniformexperimentdesignmethodacaseofphonocardiogramtestinginpatientswithheartdiseases AT choujyhhorng robustoptimizationofconvolutionalneuralnetworkswithauniformexperimentdesignmethodacaseofphonocardiogramtestinginpatientswithheartdiseases AT qujinyi robustoptimizationofconvolutionalneuralnetworkswithauniformexperimentdesignmethodacaseofphonocardiogramtestinginpatientswithheartdiseases AT changpochih robustoptimizationofconvolutionalneuralnetworkswithauniformexperimentdesignmethodacaseofphonocardiogramtestinginpatientswithheartdiseases AT choufui robustoptimizationofconvolutionalneuralnetworkswithauniformexperimentdesignmethodacaseofphonocardiogramtestinginpatientswithheartdiseases AT tsaijinntsong robustoptimizationofconvolutionalneuralnetworkswithauniformexperimentdesignmethodacaseofphonocardiogramtestinginpatientswithheartdiseases |