Cargando…

Valence-arousal classification of emotion evoked by Chinese ancient-style music using 1D-CNN-BiLSTM model on EEG signals for college students

During the COVID-19 pandemic, young people are using multimedia content more frequently to communicate with each other on Internet platforms. Among them, music, as psychological support for a lonely life in this special period, is a powerful tool for emotional self-regulation and getting rid of lone...

Descripción completa

Detalles Bibliográficos
Autores principales: Du, Ruoyu, Zhu, Shujin, Ni, Huangjing, Mao, Tianyi, Li, Jiajia, Wei, Ran
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer US 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9530425/
https://www.ncbi.nlm.nih.gov/pubmed/36213341
http://dx.doi.org/10.1007/s11042-022-14011-7
_version_ 1784801679398404096
author Du, Ruoyu
Zhu, Shujin
Ni, Huangjing
Mao, Tianyi
Li, Jiajia
Wei, Ran
author_facet Du, Ruoyu
Zhu, Shujin
Ni, Huangjing
Mao, Tianyi
Li, Jiajia
Wei, Ran
author_sort Du, Ruoyu
collection PubMed
description During the COVID-19 pandemic, young people are using multimedia content more frequently to communicate with each other on Internet platforms. Among them, music, as psychological support for a lonely life in this special period, is a powerful tool for emotional self-regulation and getting rid of loneliness. More and more attention has been paid to the music recommender system based on emotion. In recent years, Chinese music has tended to be considered an independent genre. Chinese ancient-style music is one of the new folk music styles in Chinese music and is becoming more and more popular among young people. The complexity of Chinese-style music brings significant challenges to the quantitative calculation of music. To effectively solve the problem of emotion classification in music information search, emotion is often characterized by valence and arousal. This paper focuses on the valence and arousal classification of Chinese ancient-style music-evoked emotion. It proposes a hybrid one-dimensional convolutional neural network and bidirectional and unidirectional long short-term memory model (1D-CNN-BiLSTM). And a self-acquisition EEG dataset for Chinese college students was designed to classify music-induced emotion by valence-arousal based on EEG. In addition to that, the proposed 1D-CNN-BILSTM model verified the performance of public datasets DEAP and DREAMER, as well as the self-acquisition dataset DESC. The experimental results show that, compared with traditional LSTM and 1D-CNN-LSTM models, the proposed method has the highest accuracy in the valence classification task of music-induced emotion, reaching 94.85%, 98.41%, and 99.27%, respectively. The accuracy of the arousal classification task also gained 93.40%, 98.23%, and 99.20%, respectively. In addition, compared with the positive valence classification results of emotion, this method has obvious advantages in negative valence classification. This study provides a computational classification model for a music recommender system with emotion. It also provides some theoretical support for the brain-computer interactive (BCI) application products of Chinese ancient-style music which is popular among young people.
format Online
Article
Text
id pubmed-9530425
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Springer US
record_format MEDLINE/PubMed
spelling pubmed-95304252022-10-04 Valence-arousal classification of emotion evoked by Chinese ancient-style music using 1D-CNN-BiLSTM model on EEG signals for college students Du, Ruoyu Zhu, Shujin Ni, Huangjing Mao, Tianyi Li, Jiajia Wei, Ran Multimed Tools Appl Article During the COVID-19 pandemic, young people are using multimedia content more frequently to communicate with each other on Internet platforms. Among them, music, as psychological support for a lonely life in this special period, is a powerful tool for emotional self-regulation and getting rid of loneliness. More and more attention has been paid to the music recommender system based on emotion. In recent years, Chinese music has tended to be considered an independent genre. Chinese ancient-style music is one of the new folk music styles in Chinese music and is becoming more and more popular among young people. The complexity of Chinese-style music brings significant challenges to the quantitative calculation of music. To effectively solve the problem of emotion classification in music information search, emotion is often characterized by valence and arousal. This paper focuses on the valence and arousal classification of Chinese ancient-style music-evoked emotion. It proposes a hybrid one-dimensional convolutional neural network and bidirectional and unidirectional long short-term memory model (1D-CNN-BiLSTM). And a self-acquisition EEG dataset for Chinese college students was designed to classify music-induced emotion by valence-arousal based on EEG. In addition to that, the proposed 1D-CNN-BILSTM model verified the performance of public datasets DEAP and DREAMER, as well as the self-acquisition dataset DESC. The experimental results show that, compared with traditional LSTM and 1D-CNN-LSTM models, the proposed method has the highest accuracy in the valence classification task of music-induced emotion, reaching 94.85%, 98.41%, and 99.27%, respectively. The accuracy of the arousal classification task also gained 93.40%, 98.23%, and 99.20%, respectively. In addition, compared with the positive valence classification results of emotion, this method has obvious advantages in negative valence classification. This study provides a computational classification model for a music recommender system with emotion. It also provides some theoretical support for the brain-computer interactive (BCI) application products of Chinese ancient-style music which is popular among young people. Springer US 2022-10-04 2023 /pmc/articles/PMC9530425/ /pubmed/36213341 http://dx.doi.org/10.1007/s11042-022-14011-7 Text en © The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2022, Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law. This article is made available via the PMC Open Access Subset for unrestricted research re-use and secondary analysis in any form or by any means with acknowledgement of the original source. These permissions are granted for the duration of the World Health Organization (WHO) declaration of COVID-19 as a global pandemic.
spellingShingle Article
Du, Ruoyu
Zhu, Shujin
Ni, Huangjing
Mao, Tianyi
Li, Jiajia
Wei, Ran
Valence-arousal classification of emotion evoked by Chinese ancient-style music using 1D-CNN-BiLSTM model on EEG signals for college students
title Valence-arousal classification of emotion evoked by Chinese ancient-style music using 1D-CNN-BiLSTM model on EEG signals for college students
title_full Valence-arousal classification of emotion evoked by Chinese ancient-style music using 1D-CNN-BiLSTM model on EEG signals for college students
title_fullStr Valence-arousal classification of emotion evoked by Chinese ancient-style music using 1D-CNN-BiLSTM model on EEG signals for college students
title_full_unstemmed Valence-arousal classification of emotion evoked by Chinese ancient-style music using 1D-CNN-BiLSTM model on EEG signals for college students
title_short Valence-arousal classification of emotion evoked by Chinese ancient-style music using 1D-CNN-BiLSTM model on EEG signals for college students
title_sort valence-arousal classification of emotion evoked by chinese ancient-style music using 1d-cnn-bilstm model on eeg signals for college students
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9530425/
https://www.ncbi.nlm.nih.gov/pubmed/36213341
http://dx.doi.org/10.1007/s11042-022-14011-7
work_keys_str_mv AT duruoyu valencearousalclassificationofemotionevokedbychineseancientstylemusicusing1dcnnbilstmmodeloneegsignalsforcollegestudents
AT zhushujin valencearousalclassificationofemotionevokedbychineseancientstylemusicusing1dcnnbilstmmodeloneegsignalsforcollegestudents
AT nihuangjing valencearousalclassificationofemotionevokedbychineseancientstylemusicusing1dcnnbilstmmodeloneegsignalsforcollegestudents
AT maotianyi valencearousalclassificationofemotionevokedbychineseancientstylemusicusing1dcnnbilstmmodeloneegsignalsforcollegestudents
AT lijiajia valencearousalclassificationofemotionevokedbychineseancientstylemusicusing1dcnnbilstmmodeloneegsignalsforcollegestudents
AT weiran valencearousalclassificationofemotionevokedbychineseancientstylemusicusing1dcnnbilstmmodeloneegsignalsforcollegestudents