Cargando…
Emotion recognition and achievement prediction for foreign language learners under the background of network teaching
At present, there are so many learners in online classroom that teachers cannot master the learning situation of each student comprehensively and in real time. Therefore, this paper first constructs a multimodal emotion recognition (ER) model based on CNN-BiGRU. Through the feature extraction of vid...
Autores principales: | , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9637875/ https://www.ncbi.nlm.nih.gov/pubmed/36353078 http://dx.doi.org/10.3389/fpsyg.2022.1017570 |
_version_ | 1784825279975260160 |
---|---|
author | Ding, Yi Xing, Wenying |
author_facet | Ding, Yi Xing, Wenying |
author_sort | Ding, Yi |
collection | PubMed |
description | At present, there are so many learners in online classroom that teachers cannot master the learning situation of each student comprehensively and in real time. Therefore, this paper first constructs a multimodal emotion recognition (ER) model based on CNN-BiGRU. Through the feature extraction of video and voice information, combined with temporal attention mechanism, the attention distribution of each modal information at different times is calculated in real time. In addition, based on the recognition of learners’ emotions, a prediction model of learners’ achievement based on emotional state assessment is proposed. C4.5 algorithm is used to predict students’ academic achievement in the multi-polarized emotional state, and the relationship between confusion and academic achievement is further explored. The experimental results show that the proposed multi-scale self-attention layer and multi-modal fusion layer can improve the achievement of ER task; moreover, there is a strong correlation between students’ confusion and foreign language achievement. Finally, the model can accurately and continuously observe students’ learning emotion and state, which provides a new idea for the reform of education modernization. |
format | Online Article Text |
id | pubmed-9637875 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-96378752022-11-08 Emotion recognition and achievement prediction for foreign language learners under the background of network teaching Ding, Yi Xing, Wenying Front Psychol Psychology At present, there are so many learners in online classroom that teachers cannot master the learning situation of each student comprehensively and in real time. Therefore, this paper first constructs a multimodal emotion recognition (ER) model based on CNN-BiGRU. Through the feature extraction of video and voice information, combined with temporal attention mechanism, the attention distribution of each modal information at different times is calculated in real time. In addition, based on the recognition of learners’ emotions, a prediction model of learners’ achievement based on emotional state assessment is proposed. C4.5 algorithm is used to predict students’ academic achievement in the multi-polarized emotional state, and the relationship between confusion and academic achievement is further explored. The experimental results show that the proposed multi-scale self-attention layer and multi-modal fusion layer can improve the achievement of ER task; moreover, there is a strong correlation between students’ confusion and foreign language achievement. Finally, the model can accurately and continuously observe students’ learning emotion and state, which provides a new idea for the reform of education modernization. Frontiers Media S.A. 2022-10-24 /pmc/articles/PMC9637875/ /pubmed/36353078 http://dx.doi.org/10.3389/fpsyg.2022.1017570 Text en Copyright © 2022 Ding and Xing. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Psychology Ding, Yi Xing, Wenying Emotion recognition and achievement prediction for foreign language learners under the background of network teaching |
title | Emotion recognition and achievement prediction for foreign language learners under the background of network teaching |
title_full | Emotion recognition and achievement prediction for foreign language learners under the background of network teaching |
title_fullStr | Emotion recognition and achievement prediction for foreign language learners under the background of network teaching |
title_full_unstemmed | Emotion recognition and achievement prediction for foreign language learners under the background of network teaching |
title_short | Emotion recognition and achievement prediction for foreign language learners under the background of network teaching |
title_sort | emotion recognition and achievement prediction for foreign language learners under the background of network teaching |
topic | Psychology |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9637875/ https://www.ncbi.nlm.nih.gov/pubmed/36353078 http://dx.doi.org/10.3389/fpsyg.2022.1017570 |
work_keys_str_mv | AT dingyi emotionrecognitionandachievementpredictionforforeignlanguagelearnersunderthebackgroundofnetworkteaching AT xingwenying emotionrecognitionandachievementpredictionforforeignlanguagelearnersunderthebackgroundofnetworkteaching |