Cargando…

The Fusion Application of Deep Learning Biological Image Visualization Technology and Human-Computer Interaction Intelligent Robot in Dance Movements

The paper aims to apply the deep learning-based image visualization technology to extract, recognize, and analyze human skeleton movements and evaluate the effect of the deep learning-based human-computer interaction (HCI) system. Dance education is researched. Firstly, the Visual Geometry Group Net...

Descripción completa

Detalles Bibliográficos
Autores principales: Jin, Nian, Wen, Lan, Xie, Kun
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Hindawi 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9514919/
https://www.ncbi.nlm.nih.gov/pubmed/36177314
http://dx.doi.org/10.1155/2022/2538896
_version_ 1784798376109277184
author Jin, Nian
Wen, Lan
Xie, Kun
author_facet Jin, Nian
Wen, Lan
Xie, Kun
author_sort Jin, Nian
collection PubMed
description The paper aims to apply the deep learning-based image visualization technology to extract, recognize, and analyze human skeleton movements and evaluate the effect of the deep learning-based human-computer interaction (HCI) system. Dance education is researched. Firstly, the Visual Geometry Group Network (VGGNet) is optimized using Convolutional Neural Network (CNN). Then, the VGGNet extracts the human skeleton movements in the OpenPose database. Secondly, the Long Short-Term Memory (LSTM) network is optimized and recognizes human skeleton movements. Finally, an HCI system for dance education is designed based on the extraction and recognition methods of human skeleton movements. Results demonstrate that the highest extraction accuracy is 96%, and the average recognition accuracy of different dance movements is stable. The effectiveness of the proposed model is verified. The recognition accuracy of the optimized F-Multiple LSTMs is increased to 88.9%, suitable for recognizing human skeleton movements. The dance education HCI system's interactive accuracy built by deep learning-based visualization technology reaches 92%; the overall response time is distributed between 5.1 s and 5.9 s. Hence, the proposed model has excellent instantaneity. Therefore, the deep learning-based image visualization technology has enormous potential in human movement recognition, and combining deep learning and HCI plays a significant role.
format Online
Article
Text
id pubmed-9514919
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Hindawi
record_format MEDLINE/PubMed
spelling pubmed-95149192022-09-28 The Fusion Application of Deep Learning Biological Image Visualization Technology and Human-Computer Interaction Intelligent Robot in Dance Movements Jin, Nian Wen, Lan Xie, Kun Comput Intell Neurosci Research Article The paper aims to apply the deep learning-based image visualization technology to extract, recognize, and analyze human skeleton movements and evaluate the effect of the deep learning-based human-computer interaction (HCI) system. Dance education is researched. Firstly, the Visual Geometry Group Network (VGGNet) is optimized using Convolutional Neural Network (CNN). Then, the VGGNet extracts the human skeleton movements in the OpenPose database. Secondly, the Long Short-Term Memory (LSTM) network is optimized and recognizes human skeleton movements. Finally, an HCI system for dance education is designed based on the extraction and recognition methods of human skeleton movements. Results demonstrate that the highest extraction accuracy is 96%, and the average recognition accuracy of different dance movements is stable. The effectiveness of the proposed model is verified. The recognition accuracy of the optimized F-Multiple LSTMs is increased to 88.9%, suitable for recognizing human skeleton movements. The dance education HCI system's interactive accuracy built by deep learning-based visualization technology reaches 92%; the overall response time is distributed between 5.1 s and 5.9 s. Hence, the proposed model has excellent instantaneity. Therefore, the deep learning-based image visualization technology has enormous potential in human movement recognition, and combining deep learning and HCI plays a significant role. Hindawi 2022-09-20 /pmc/articles/PMC9514919/ /pubmed/36177314 http://dx.doi.org/10.1155/2022/2538896 Text en Copyright © 2022 Nian Jin et al. https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Research Article
Jin, Nian
Wen, Lan
Xie, Kun
The Fusion Application of Deep Learning Biological Image Visualization Technology and Human-Computer Interaction Intelligent Robot in Dance Movements
title The Fusion Application of Deep Learning Biological Image Visualization Technology and Human-Computer Interaction Intelligent Robot in Dance Movements
title_full The Fusion Application of Deep Learning Biological Image Visualization Technology and Human-Computer Interaction Intelligent Robot in Dance Movements
title_fullStr The Fusion Application of Deep Learning Biological Image Visualization Technology and Human-Computer Interaction Intelligent Robot in Dance Movements
title_full_unstemmed The Fusion Application of Deep Learning Biological Image Visualization Technology and Human-Computer Interaction Intelligent Robot in Dance Movements
title_short The Fusion Application of Deep Learning Biological Image Visualization Technology and Human-Computer Interaction Intelligent Robot in Dance Movements
title_sort fusion application of deep learning biological image visualization technology and human-computer interaction intelligent robot in dance movements
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9514919/
https://www.ncbi.nlm.nih.gov/pubmed/36177314
http://dx.doi.org/10.1155/2022/2538896
work_keys_str_mv AT jinnian thefusionapplicationofdeeplearningbiologicalimagevisualizationtechnologyandhumancomputerinteractionintelligentrobotindancemovements
AT wenlan thefusionapplicationofdeeplearningbiologicalimagevisualizationtechnologyandhumancomputerinteractionintelligentrobotindancemovements
AT xiekun thefusionapplicationofdeeplearningbiologicalimagevisualizationtechnologyandhumancomputerinteractionintelligentrobotindancemovements
AT jinnian fusionapplicationofdeeplearningbiologicalimagevisualizationtechnologyandhumancomputerinteractionintelligentrobotindancemovements
AT wenlan fusionapplicationofdeeplearningbiologicalimagevisualizationtechnologyandhumancomputerinteractionintelligentrobotindancemovements
AT xiekun fusionapplicationofdeeplearningbiologicalimagevisualizationtechnologyandhumancomputerinteractionintelligentrobotindancemovements