Cargando…

Evaluation Technology of Classroom Students' Learning State Based on Deep Learning

Facial features are an effective representation of students' fatigue state, and the eye is more closely related to fatigue state. However, there are three main problems in the existing research: (1) the positioning of the eye is vulnerable to the external environment; (2) the ocular features ne...

Descripción completa

Detalles Bibliográficos
Autor principal: Chen, Lingjing
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Hindawi 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8548165/
https://www.ncbi.nlm.nih.gov/pubmed/34712318
http://dx.doi.org/10.1155/2021/6999347
_version_ 1784590516220854272
author Chen, Lingjing
author_facet Chen, Lingjing
author_sort Chen, Lingjing
collection PubMed
description Facial features are an effective representation of students' fatigue state, and the eye is more closely related to fatigue state. However, there are three main problems in the existing research: (1) the positioning of the eye is vulnerable to the external environment; (2) the ocular features need to be artificially defined and extracted for state judgment; and (3) although the student fatigue state detection based on convolutional neural network has a high accuracy, it is difficult to apply in the terminal side in real time. In view of the above problems, a method of student fatigue state judgment is proposed which combines face detection and lightweight depth learning technology. First, the AdaBoost algorithm is used to detect the human face from the input images, and the images marked with human face regions are saved to the local folder, which is used as the sample dataset of the open-close judgment part. Second, a novel reconstructed pyramid structure is proposed to improve the MobileNetV2-SSD to improve the accuracy of target detection. Then, the feature enhancement suppression mechanism based on SE-Net module is introduced to effectively improve the feature expression ability. The final experimental results show that, compared with the current commonly used target detection network, the proposed method has better classification ability for eye state and is improved in real-time performance and accuracy.
format Online
Article
Text
id pubmed-8548165
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Hindawi
record_format MEDLINE/PubMed
spelling pubmed-85481652021-10-27 Evaluation Technology of Classroom Students' Learning State Based on Deep Learning Chen, Lingjing Comput Intell Neurosci Research Article Facial features are an effective representation of students' fatigue state, and the eye is more closely related to fatigue state. However, there are three main problems in the existing research: (1) the positioning of the eye is vulnerable to the external environment; (2) the ocular features need to be artificially defined and extracted for state judgment; and (3) although the student fatigue state detection based on convolutional neural network has a high accuracy, it is difficult to apply in the terminal side in real time. In view of the above problems, a method of student fatigue state judgment is proposed which combines face detection and lightweight depth learning technology. First, the AdaBoost algorithm is used to detect the human face from the input images, and the images marked with human face regions are saved to the local folder, which is used as the sample dataset of the open-close judgment part. Second, a novel reconstructed pyramid structure is proposed to improve the MobileNetV2-SSD to improve the accuracy of target detection. Then, the feature enhancement suppression mechanism based on SE-Net module is introduced to effectively improve the feature expression ability. The final experimental results show that, compared with the current commonly used target detection network, the proposed method has better classification ability for eye state and is improved in real-time performance and accuracy. Hindawi 2021-10-19 /pmc/articles/PMC8548165/ /pubmed/34712318 http://dx.doi.org/10.1155/2021/6999347 Text en Copyright © 2021 Lingjing Chen. https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Research Article
Chen, Lingjing
Evaluation Technology of Classroom Students' Learning State Based on Deep Learning
title Evaluation Technology of Classroom Students' Learning State Based on Deep Learning
title_full Evaluation Technology of Classroom Students' Learning State Based on Deep Learning
title_fullStr Evaluation Technology of Classroom Students' Learning State Based on Deep Learning
title_full_unstemmed Evaluation Technology of Classroom Students' Learning State Based on Deep Learning
title_short Evaluation Technology of Classroom Students' Learning State Based on Deep Learning
title_sort evaluation technology of classroom students' learning state based on deep learning
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8548165/
https://www.ncbi.nlm.nih.gov/pubmed/34712318
http://dx.doi.org/10.1155/2021/6999347
work_keys_str_mv AT chenlingjing evaluationtechnologyofclassroomstudentslearningstatebasedondeeplearning