Cargando…

Recognition of musical beat and style and applications in interactive humanoid robot

The musical beat and style recognition have high application value in music information retrieval. However, the traditional methods mostly use a convolutional neural network (CNN) as the backbone and have poor performance. Accordingly, the present work chooses a recurrent neural network (RNN) in dee...

Descripción completa

Detalles Bibliográficos
Autor principal: Chu, Yue
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9386054/
https://www.ncbi.nlm.nih.gov/pubmed/35990882
http://dx.doi.org/10.3389/fnbot.2022.875058
_version_ 1784769716665974784
author Chu, Yue
author_facet Chu, Yue
author_sort Chu, Yue
collection PubMed
description The musical beat and style recognition have high application value in music information retrieval. However, the traditional methods mostly use a convolutional neural network (CNN) as the backbone and have poor performance. Accordingly, the present work chooses a recurrent neural network (RNN) in deep learning (DL) to identify musical beats and styles. The proposed model is applied to an interactive humanoid robot. First, DL-based musical beat and style recognition technologies are studied. On this basis, a note beat recognition method combining attention mechanism (AM) and independent RNN (IndRNN) [AM-IndRNN] is proposed. The AM-IndRNN can effectively avoid gradient vanishing and gradient exploding. Second, the audio music files are divided into multiple styles using the music signal's temporal features. A human dancing robot using a multimodal drive is constructed. Finally, the proposed method is tested. The results show that the proposed AM-IndRNN outperforms multiple parallel long short-term memory (LSTM) models and IndRNN in recognition accuracy (88.9%) and loss rate (0.0748). Therefore, the AM-optimized LSTM model has gained a higher recognition accuracy. The research results provide specific ideas for applying DL technology in musical beat and style recognition.
format Online
Article
Text
id pubmed-9386054
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-93860542022-08-19 Recognition of musical beat and style and applications in interactive humanoid robot Chu, Yue Front Neurorobot Neuroscience The musical beat and style recognition have high application value in music information retrieval. However, the traditional methods mostly use a convolutional neural network (CNN) as the backbone and have poor performance. Accordingly, the present work chooses a recurrent neural network (RNN) in deep learning (DL) to identify musical beats and styles. The proposed model is applied to an interactive humanoid robot. First, DL-based musical beat and style recognition technologies are studied. On this basis, a note beat recognition method combining attention mechanism (AM) and independent RNN (IndRNN) [AM-IndRNN] is proposed. The AM-IndRNN can effectively avoid gradient vanishing and gradient exploding. Second, the audio music files are divided into multiple styles using the music signal's temporal features. A human dancing robot using a multimodal drive is constructed. Finally, the proposed method is tested. The results show that the proposed AM-IndRNN outperforms multiple parallel long short-term memory (LSTM) models and IndRNN in recognition accuracy (88.9%) and loss rate (0.0748). Therefore, the AM-optimized LSTM model has gained a higher recognition accuracy. The research results provide specific ideas for applying DL technology in musical beat and style recognition. Frontiers Media S.A. 2022-08-04 /pmc/articles/PMC9386054/ /pubmed/35990882 http://dx.doi.org/10.3389/fnbot.2022.875058 Text en Copyright © 2022 Chu. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Chu, Yue
Recognition of musical beat and style and applications in interactive humanoid robot
title Recognition of musical beat and style and applications in interactive humanoid robot
title_full Recognition of musical beat and style and applications in interactive humanoid robot
title_fullStr Recognition of musical beat and style and applications in interactive humanoid robot
title_full_unstemmed Recognition of musical beat and style and applications in interactive humanoid robot
title_short Recognition of musical beat and style and applications in interactive humanoid robot
title_sort recognition of musical beat and style and applications in interactive humanoid robot
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9386054/
https://www.ncbi.nlm.nih.gov/pubmed/35990882
http://dx.doi.org/10.3389/fnbot.2022.875058
work_keys_str_mv AT chuyue recognitionofmusicalbeatandstyleandapplicationsininteractivehumanoidrobot