Cargando…

Analysis of Main Movement Characteristics of Hip Hop Dance Based on Deep Learning of Dance Movements

In order to explore the main action characteristics of hip hop dance, a deep learning recognition system based on dance action is proposed. The network is based on convolution, pooling, and full connection calculation in a convolutional neural network (CNN). On the one hand, the pixel information in...

Descripción completa

Detalles Bibliográficos
Autor principal: Lu, Rui
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Hindawi 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9152375/
https://www.ncbi.nlm.nih.gov/pubmed/35655507
http://dx.doi.org/10.1155/2022/6794018
_version_ 1784717632456359936
author Lu, Rui
author_facet Lu, Rui
author_sort Lu, Rui
collection PubMed
description In order to explore the main action characteristics of hip hop dance, a deep learning recognition system based on dance action is proposed. The network is based on convolution, pooling, and full connection calculation in a convolutional neural network (CNN). On the one hand, the pixel information in the video frame is extracted as the network input feature in the spatial domain. On the other hand, in the time domain, in order to better represent the change characteristics of video actions, optical flow information is introduced, and the optical flow vector change of pixels in DT time is calculated by the pyramid algorithm (LK) as the time domain convolution feature. In order to evaluate the performance of the network, this article takes the recognition of dance movements as an example to test the application of the algorithm. The test dataset contains 101 fully identified dance movements. The test results show that the proposed algorithm is 10.90% higher than F1 of inception V3, and the recognition accuracy is 10.85% and 5.27% higher than that of inception V3 and 3D-CNN networks, respectively. For the problems and difficulties brought by single-mode video action recognition, a multimodal action recognition method is introduced to achieve better results based on a large number of training data. Different depth networks have different characteristics. CNN network pays more attention to the relationship between local information, so it is suitable for image recognition and detection tasks. The RNN network is expanded in the time dimension, so it is suitable for the modal information related to similar videos. Therefore, based on multimodal information and a depth neural network, a depth feature extraction and fusion method for multimodal information is designed. Different methods of feature extraction and fusion are tried in the experiment, and the experimental results are analyzed. It proves that the deep learning and recognition of dance movement can effectively explore the main movement characteristics of hip hop dance.
format Online
Article
Text
id pubmed-9152375
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Hindawi
record_format MEDLINE/PubMed
spelling pubmed-91523752022-06-01 Analysis of Main Movement Characteristics of Hip Hop Dance Based on Deep Learning of Dance Movements Lu, Rui Comput Intell Neurosci Research Article In order to explore the main action characteristics of hip hop dance, a deep learning recognition system based on dance action is proposed. The network is based on convolution, pooling, and full connection calculation in a convolutional neural network (CNN). On the one hand, the pixel information in the video frame is extracted as the network input feature in the spatial domain. On the other hand, in the time domain, in order to better represent the change characteristics of video actions, optical flow information is introduced, and the optical flow vector change of pixels in DT time is calculated by the pyramid algorithm (LK) as the time domain convolution feature. In order to evaluate the performance of the network, this article takes the recognition of dance movements as an example to test the application of the algorithm. The test dataset contains 101 fully identified dance movements. The test results show that the proposed algorithm is 10.90% higher than F1 of inception V3, and the recognition accuracy is 10.85% and 5.27% higher than that of inception V3 and 3D-CNN networks, respectively. For the problems and difficulties brought by single-mode video action recognition, a multimodal action recognition method is introduced to achieve better results based on a large number of training data. Different depth networks have different characteristics. CNN network pays more attention to the relationship between local information, so it is suitable for image recognition and detection tasks. The RNN network is expanded in the time dimension, so it is suitable for the modal information related to similar videos. Therefore, based on multimodal information and a depth neural network, a depth feature extraction and fusion method for multimodal information is designed. Different methods of feature extraction and fusion are tried in the experiment, and the experimental results are analyzed. It proves that the deep learning and recognition of dance movement can effectively explore the main movement characteristics of hip hop dance. Hindawi 2022-05-23 /pmc/articles/PMC9152375/ /pubmed/35655507 http://dx.doi.org/10.1155/2022/6794018 Text en Copyright © 2022 Rui Lu. https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Research Article
Lu, Rui
Analysis of Main Movement Characteristics of Hip Hop Dance Based on Deep Learning of Dance Movements
title Analysis of Main Movement Characteristics of Hip Hop Dance Based on Deep Learning of Dance Movements
title_full Analysis of Main Movement Characteristics of Hip Hop Dance Based on Deep Learning of Dance Movements
title_fullStr Analysis of Main Movement Characteristics of Hip Hop Dance Based on Deep Learning of Dance Movements
title_full_unstemmed Analysis of Main Movement Characteristics of Hip Hop Dance Based on Deep Learning of Dance Movements
title_short Analysis of Main Movement Characteristics of Hip Hop Dance Based on Deep Learning of Dance Movements
title_sort analysis of main movement characteristics of hip hop dance based on deep learning of dance movements
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9152375/
https://www.ncbi.nlm.nih.gov/pubmed/35655507
http://dx.doi.org/10.1155/2022/6794018
work_keys_str_mv AT lurui analysisofmainmovementcharacteristicsofhiphopdancebasedondeeplearningofdancemovements