Cargando…

The Role of Knowledge Creation-Oriented Convolutional Neural Network in Learning Interaction

When convolutional neural network (CNN) applications have different tasks in the source domain and target domain, but both have labels, it is easy to ignore the difference between the source domain and target domain by using the current traditional method, and the recognition effect of image feature...

Descripción completa

Detalles Bibliográficos
Autores principales: Zhang, Hongyan, Luo, Xiaoguang
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Hindawi 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8942628/
https://www.ncbi.nlm.nih.gov/pubmed/35341199
http://dx.doi.org/10.1155/2022/6493311
_version_ 1784673342496702464
author Zhang, Hongyan
Luo, Xiaoguang
author_facet Zhang, Hongyan
Luo, Xiaoguang
author_sort Zhang, Hongyan
collection PubMed
description When convolutional neural network (CNN) applications have different tasks in the source domain and target domain, but both have labels, it is easy to ignore the difference between the source domain and target domain by using the current traditional method, and the recognition effect of image features is not ideal. This paper proposes a deep migration learning method based on improved ResNet based on existing research to avoid this problem. This method extracts high-order statistical features of images by increasing the number of network layers for classification when performing model transfer learning. The ImageNet dataset is used as the source domain, and a Deep Residual Network (DRN) is used for model transfer based on homogeneous data. Firstly, the ResNet model is pretrained. Then, the last fully connected layer of the source model is modified, and the final deep model is constructed by fine-tuning the network by adding an adjustment module. The impact of content differences between datasets on recognizing transfer learning features is reduced through model transfer and deep feature extraction. The deep transfer learning methods after improving ResNet are compared through experiments. The identification algorithm is based on Support Vector Machine (SVM), the deep transfer learning method on Visual Geometry Group (VGG)-19, and the deep transfer learning method based on Inception-V3. Four experiments are performed on MNIST and CIFAR-10 datasets. By analyzing the experimental data, ResNet's improved deep transfer learning method achieves 97.98% and 90.45% accuracy on the MNIST and CIFAR-10 datasets, and 95.33% and 85.07% on the test set. The accuracy and recognition accuracy on the training and test sets have been improved to a certain extent. The combination of CNN and transfer learning can effectively alleviate the difficulty of obtaining labeled data. Therefore, the application of a CNN in transfer learning is significant.
format Online
Article
Text
id pubmed-8942628
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Hindawi
record_format MEDLINE/PubMed
spelling pubmed-89426282022-03-24 The Role of Knowledge Creation-Oriented Convolutional Neural Network in Learning Interaction Zhang, Hongyan Luo, Xiaoguang Comput Intell Neurosci Research Article When convolutional neural network (CNN) applications have different tasks in the source domain and target domain, but both have labels, it is easy to ignore the difference between the source domain and target domain by using the current traditional method, and the recognition effect of image features is not ideal. This paper proposes a deep migration learning method based on improved ResNet based on existing research to avoid this problem. This method extracts high-order statistical features of images by increasing the number of network layers for classification when performing model transfer learning. The ImageNet dataset is used as the source domain, and a Deep Residual Network (DRN) is used for model transfer based on homogeneous data. Firstly, the ResNet model is pretrained. Then, the last fully connected layer of the source model is modified, and the final deep model is constructed by fine-tuning the network by adding an adjustment module. The impact of content differences between datasets on recognizing transfer learning features is reduced through model transfer and deep feature extraction. The deep transfer learning methods after improving ResNet are compared through experiments. The identification algorithm is based on Support Vector Machine (SVM), the deep transfer learning method on Visual Geometry Group (VGG)-19, and the deep transfer learning method based on Inception-V3. Four experiments are performed on MNIST and CIFAR-10 datasets. By analyzing the experimental data, ResNet's improved deep transfer learning method achieves 97.98% and 90.45% accuracy on the MNIST and CIFAR-10 datasets, and 95.33% and 85.07% on the test set. The accuracy and recognition accuracy on the training and test sets have been improved to a certain extent. The combination of CNN and transfer learning can effectively alleviate the difficulty of obtaining labeled data. Therefore, the application of a CNN in transfer learning is significant. Hindawi 2022-03-16 /pmc/articles/PMC8942628/ /pubmed/35341199 http://dx.doi.org/10.1155/2022/6493311 Text en Copyright © 2022 Hongyan Zhang and Xiaoguang Luo. https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Research Article
Zhang, Hongyan
Luo, Xiaoguang
The Role of Knowledge Creation-Oriented Convolutional Neural Network in Learning Interaction
title The Role of Knowledge Creation-Oriented Convolutional Neural Network in Learning Interaction
title_full The Role of Knowledge Creation-Oriented Convolutional Neural Network in Learning Interaction
title_fullStr The Role of Knowledge Creation-Oriented Convolutional Neural Network in Learning Interaction
title_full_unstemmed The Role of Knowledge Creation-Oriented Convolutional Neural Network in Learning Interaction
title_short The Role of Knowledge Creation-Oriented Convolutional Neural Network in Learning Interaction
title_sort role of knowledge creation-oriented convolutional neural network in learning interaction
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8942628/
https://www.ncbi.nlm.nih.gov/pubmed/35341199
http://dx.doi.org/10.1155/2022/6493311
work_keys_str_mv AT zhanghongyan theroleofknowledgecreationorientedconvolutionalneuralnetworkinlearninginteraction
AT luoxiaoguang theroleofknowledgecreationorientedconvolutionalneuralnetworkinlearninginteraction
AT zhanghongyan roleofknowledgecreationorientedconvolutionalneuralnetworkinlearninginteraction
AT luoxiaoguang roleofknowledgecreationorientedconvolutionalneuralnetworkinlearninginteraction