Cargando…

Research on Data Analysis Network of TCM Tongue Diagnosis Based on Deep Learning Technology

The aim of the study is to build a tongue image intelligent analysis “end-to-end” deep learning network based on a tongue diagnosis image of traditional Chinese medicine. The tongue target region in the original image was segmented by the UNet tongue segmentation model at the front end of the networ...

Descripción completa

Detalles Bibliográficos
Autores principales: Li, Zongrun, Ren, Xiujuan, Xiao, Lin, Qi, Jing, Fu, Tianli, Li, Weihong
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Hindawi 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8983244/
https://www.ncbi.nlm.nih.gov/pubmed/35392154
http://dx.doi.org/10.1155/2022/9372807
_version_ 1784681943206461440
author Li, Zongrun
Ren, Xiujuan
Xiao, Lin
Qi, Jing
Fu, Tianli
Li, Weihong
author_facet Li, Zongrun
Ren, Xiujuan
Xiao, Lin
Qi, Jing
Fu, Tianli
Li, Weihong
author_sort Li, Zongrun
collection PubMed
description The aim of the study is to build a tongue image intelligent analysis “end-to-end” deep learning network based on a tongue diagnosis image of traditional Chinese medicine. The tongue target region in the original image was segmented by the UNet tongue segmentation model at the front end of the network. After segmentation, the feature vector of the tongue target region was extracted by the ResNet network, and then the blood pressure on the day of shooting was fused with the feature vector extracted by the ResNet network through the convolution operation method to complete the extraction of two groups of data of tongue feature and fusion feature. Based on analyzing the data of blood pressure, tongue image, and their fusion at the end of the network, four regression analysis methods were used to predict the stage mean value. After training, the model is tested with the test set data, and the test results are evaluated with mean absolute error (MAE). The prediction error of the model based on the fusion data of tongue image and blood pressure on the day of shooting was lower than that of the other two data modes. The UNet tongue segmentation model combined with the ResNet network can realize the automatic extraction of tongue image features. The extracted features combined with machine learning modeling can be used to explore the complex hierarchical mathematical association between tongue image and clinical data. The experimental results show that the multimodal data fusion method is an important way to mine the clinical value of the TCM tongue image.
format Online
Article
Text
id pubmed-8983244
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Hindawi
record_format MEDLINE/PubMed
spelling pubmed-89832442022-04-06 Research on Data Analysis Network of TCM Tongue Diagnosis Based on Deep Learning Technology Li, Zongrun Ren, Xiujuan Xiao, Lin Qi, Jing Fu, Tianli Li, Weihong J Healthc Eng Research Article The aim of the study is to build a tongue image intelligent analysis “end-to-end” deep learning network based on a tongue diagnosis image of traditional Chinese medicine. The tongue target region in the original image was segmented by the UNet tongue segmentation model at the front end of the network. After segmentation, the feature vector of the tongue target region was extracted by the ResNet network, and then the blood pressure on the day of shooting was fused with the feature vector extracted by the ResNet network through the convolution operation method to complete the extraction of two groups of data of tongue feature and fusion feature. Based on analyzing the data of blood pressure, tongue image, and their fusion at the end of the network, four regression analysis methods were used to predict the stage mean value. After training, the model is tested with the test set data, and the test results are evaluated with mean absolute error (MAE). The prediction error of the model based on the fusion data of tongue image and blood pressure on the day of shooting was lower than that of the other two data modes. The UNet tongue segmentation model combined with the ResNet network can realize the automatic extraction of tongue image features. The extracted features combined with machine learning modeling can be used to explore the complex hierarchical mathematical association between tongue image and clinical data. The experimental results show that the multimodal data fusion method is an important way to mine the clinical value of the TCM tongue image. Hindawi 2022-03-29 /pmc/articles/PMC8983244/ /pubmed/35392154 http://dx.doi.org/10.1155/2022/9372807 Text en Copyright © 2022 Zongrun Li et al. https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Research Article
Li, Zongrun
Ren, Xiujuan
Xiao, Lin
Qi, Jing
Fu, Tianli
Li, Weihong
Research on Data Analysis Network of TCM Tongue Diagnosis Based on Deep Learning Technology
title Research on Data Analysis Network of TCM Tongue Diagnosis Based on Deep Learning Technology
title_full Research on Data Analysis Network of TCM Tongue Diagnosis Based on Deep Learning Technology
title_fullStr Research on Data Analysis Network of TCM Tongue Diagnosis Based on Deep Learning Technology
title_full_unstemmed Research on Data Analysis Network of TCM Tongue Diagnosis Based on Deep Learning Technology
title_short Research on Data Analysis Network of TCM Tongue Diagnosis Based on Deep Learning Technology
title_sort research on data analysis network of tcm tongue diagnosis based on deep learning technology
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8983244/
https://www.ncbi.nlm.nih.gov/pubmed/35392154
http://dx.doi.org/10.1155/2022/9372807
work_keys_str_mv AT lizongrun researchondataanalysisnetworkoftcmtonguediagnosisbasedondeeplearningtechnology
AT renxiujuan researchondataanalysisnetworkoftcmtonguediagnosisbasedondeeplearningtechnology
AT xiaolin researchondataanalysisnetworkoftcmtonguediagnosisbasedondeeplearningtechnology
AT qijing researchondataanalysisnetworkoftcmtonguediagnosisbasedondeeplearningtechnology
AT futianli researchondataanalysisnetworkoftcmtonguediagnosisbasedondeeplearningtechnology
AT liweihong researchondataanalysisnetworkoftcmtonguediagnosisbasedondeeplearningtechnology