Cargando…

Emotion recognition and achievement prediction for foreign language learners under the background of network teaching

At present, there are so many learners in online classroom that teachers cannot master the learning situation of each student comprehensively and in real time. Therefore, this paper first constructs a multimodal emotion recognition (ER) model based on CNN-BiGRU. Through the feature extraction of vid...

Descripción completa

Detalles Bibliográficos
Autores principales: Ding, Yi, Xing, Wenying
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9637875/
https://www.ncbi.nlm.nih.gov/pubmed/36353078
http://dx.doi.org/10.3389/fpsyg.2022.1017570
_version_ 1784825279975260160
author Ding, Yi
Xing, Wenying
author_facet Ding, Yi
Xing, Wenying
author_sort Ding, Yi
collection PubMed
description At present, there are so many learners in online classroom that teachers cannot master the learning situation of each student comprehensively and in real time. Therefore, this paper first constructs a multimodal emotion recognition (ER) model based on CNN-BiGRU. Through the feature extraction of video and voice information, combined with temporal attention mechanism, the attention distribution of each modal information at different times is calculated in real time. In addition, based on the recognition of learners’ emotions, a prediction model of learners’ achievement based on emotional state assessment is proposed. C4.5 algorithm is used to predict students’ academic achievement in the multi-polarized emotional state, and the relationship between confusion and academic achievement is further explored. The experimental results show that the proposed multi-scale self-attention layer and multi-modal fusion layer can improve the achievement of ER task; moreover, there is a strong correlation between students’ confusion and foreign language achievement. Finally, the model can accurately and continuously observe students’ learning emotion and state, which provides a new idea for the reform of education modernization.
format Online
Article
Text
id pubmed-9637875
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-96378752022-11-08 Emotion recognition and achievement prediction for foreign language learners under the background of network teaching Ding, Yi Xing, Wenying Front Psychol Psychology At present, there are so many learners in online classroom that teachers cannot master the learning situation of each student comprehensively and in real time. Therefore, this paper first constructs a multimodal emotion recognition (ER) model based on CNN-BiGRU. Through the feature extraction of video and voice information, combined with temporal attention mechanism, the attention distribution of each modal information at different times is calculated in real time. In addition, based on the recognition of learners’ emotions, a prediction model of learners’ achievement based on emotional state assessment is proposed. C4.5 algorithm is used to predict students’ academic achievement in the multi-polarized emotional state, and the relationship between confusion and academic achievement is further explored. The experimental results show that the proposed multi-scale self-attention layer and multi-modal fusion layer can improve the achievement of ER task; moreover, there is a strong correlation between students’ confusion and foreign language achievement. Finally, the model can accurately and continuously observe students’ learning emotion and state, which provides a new idea for the reform of education modernization. Frontiers Media S.A. 2022-10-24 /pmc/articles/PMC9637875/ /pubmed/36353078 http://dx.doi.org/10.3389/fpsyg.2022.1017570 Text en Copyright © 2022 Ding and Xing. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Psychology
Ding, Yi
Xing, Wenying
Emotion recognition and achievement prediction for foreign language learners under the background of network teaching
title Emotion recognition and achievement prediction for foreign language learners under the background of network teaching
title_full Emotion recognition and achievement prediction for foreign language learners under the background of network teaching
title_fullStr Emotion recognition and achievement prediction for foreign language learners under the background of network teaching
title_full_unstemmed Emotion recognition and achievement prediction for foreign language learners under the background of network teaching
title_short Emotion recognition and achievement prediction for foreign language learners under the background of network teaching
title_sort emotion recognition and achievement prediction for foreign language learners under the background of network teaching
topic Psychology
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9637875/
https://www.ncbi.nlm.nih.gov/pubmed/36353078
http://dx.doi.org/10.3389/fpsyg.2022.1017570
work_keys_str_mv AT dingyi emotionrecognitionandachievementpredictionforforeignlanguagelearnersunderthebackgroundofnetworkteaching
AT xingwenying emotionrecognitionandachievementpredictionforforeignlanguagelearnersunderthebackgroundofnetworkteaching