Cargando…
Research on Data Analysis Network of TCM Tongue Diagnosis Based on Deep Learning Technology
The aim of the study is to build a tongue image intelligent analysis “end-to-end” deep learning network based on a tongue diagnosis image of traditional Chinese medicine. The tongue target region in the original image was segmented by the UNet tongue segmentation model at the front end of the networ...
Autores principales: | , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Hindawi
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8983244/ https://www.ncbi.nlm.nih.gov/pubmed/35392154 http://dx.doi.org/10.1155/2022/9372807 |
_version_ | 1784681943206461440 |
---|---|
author | Li, Zongrun Ren, Xiujuan Xiao, Lin Qi, Jing Fu, Tianli Li, Weihong |
author_facet | Li, Zongrun Ren, Xiujuan Xiao, Lin Qi, Jing Fu, Tianli Li, Weihong |
author_sort | Li, Zongrun |
collection | PubMed |
description | The aim of the study is to build a tongue image intelligent analysis “end-to-end” deep learning network based on a tongue diagnosis image of traditional Chinese medicine. The tongue target region in the original image was segmented by the UNet tongue segmentation model at the front end of the network. After segmentation, the feature vector of the tongue target region was extracted by the ResNet network, and then the blood pressure on the day of shooting was fused with the feature vector extracted by the ResNet network through the convolution operation method to complete the extraction of two groups of data of tongue feature and fusion feature. Based on analyzing the data of blood pressure, tongue image, and their fusion at the end of the network, four regression analysis methods were used to predict the stage mean value. After training, the model is tested with the test set data, and the test results are evaluated with mean absolute error (MAE). The prediction error of the model based on the fusion data of tongue image and blood pressure on the day of shooting was lower than that of the other two data modes. The UNet tongue segmentation model combined with the ResNet network can realize the automatic extraction of tongue image features. The extracted features combined with machine learning modeling can be used to explore the complex hierarchical mathematical association between tongue image and clinical data. The experimental results show that the multimodal data fusion method is an important way to mine the clinical value of the TCM tongue image. |
format | Online Article Text |
id | pubmed-8983244 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Hindawi |
record_format | MEDLINE/PubMed |
spelling | pubmed-89832442022-04-06 Research on Data Analysis Network of TCM Tongue Diagnosis Based on Deep Learning Technology Li, Zongrun Ren, Xiujuan Xiao, Lin Qi, Jing Fu, Tianli Li, Weihong J Healthc Eng Research Article The aim of the study is to build a tongue image intelligent analysis “end-to-end” deep learning network based on a tongue diagnosis image of traditional Chinese medicine. The tongue target region in the original image was segmented by the UNet tongue segmentation model at the front end of the network. After segmentation, the feature vector of the tongue target region was extracted by the ResNet network, and then the blood pressure on the day of shooting was fused with the feature vector extracted by the ResNet network through the convolution operation method to complete the extraction of two groups of data of tongue feature and fusion feature. Based on analyzing the data of blood pressure, tongue image, and their fusion at the end of the network, four regression analysis methods were used to predict the stage mean value. After training, the model is tested with the test set data, and the test results are evaluated with mean absolute error (MAE). The prediction error of the model based on the fusion data of tongue image and blood pressure on the day of shooting was lower than that of the other two data modes. The UNet tongue segmentation model combined with the ResNet network can realize the automatic extraction of tongue image features. The extracted features combined with machine learning modeling can be used to explore the complex hierarchical mathematical association between tongue image and clinical data. The experimental results show that the multimodal data fusion method is an important way to mine the clinical value of the TCM tongue image. Hindawi 2022-03-29 /pmc/articles/PMC8983244/ /pubmed/35392154 http://dx.doi.org/10.1155/2022/9372807 Text en Copyright © 2022 Zongrun Li et al. https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. |
spellingShingle | Research Article Li, Zongrun Ren, Xiujuan Xiao, Lin Qi, Jing Fu, Tianli Li, Weihong Research on Data Analysis Network of TCM Tongue Diagnosis Based on Deep Learning Technology |
title | Research on Data Analysis Network of TCM Tongue Diagnosis Based on Deep Learning Technology |
title_full | Research on Data Analysis Network of TCM Tongue Diagnosis Based on Deep Learning Technology |
title_fullStr | Research on Data Analysis Network of TCM Tongue Diagnosis Based on Deep Learning Technology |
title_full_unstemmed | Research on Data Analysis Network of TCM Tongue Diagnosis Based on Deep Learning Technology |
title_short | Research on Data Analysis Network of TCM Tongue Diagnosis Based on Deep Learning Technology |
title_sort | research on data analysis network of tcm tongue diagnosis based on deep learning technology |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8983244/ https://www.ncbi.nlm.nih.gov/pubmed/35392154 http://dx.doi.org/10.1155/2022/9372807 |
work_keys_str_mv | AT lizongrun researchondataanalysisnetworkoftcmtonguediagnosisbasedondeeplearningtechnology AT renxiujuan researchondataanalysisnetworkoftcmtonguediagnosisbasedondeeplearningtechnology AT xiaolin researchondataanalysisnetworkoftcmtonguediagnosisbasedondeeplearningtechnology AT qijing researchondataanalysisnetworkoftcmtonguediagnosisbasedondeeplearningtechnology AT futianli researchondataanalysisnetworkoftcmtonguediagnosisbasedondeeplearningtechnology AT liweihong researchondataanalysisnetworkoftcmtonguediagnosisbasedondeeplearningtechnology |