Cargando…
Evaluation Technology of Classroom Students' Learning State Based on Deep Learning
Facial features are an effective representation of students' fatigue state, and the eye is more closely related to fatigue state. However, there are three main problems in the existing research: (1) the positioning of the eye is vulnerable to the external environment; (2) the ocular features ne...
Autor principal: | |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Hindawi
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8548165/ https://www.ncbi.nlm.nih.gov/pubmed/34712318 http://dx.doi.org/10.1155/2021/6999347 |
_version_ | 1784590516220854272 |
---|---|
author | Chen, Lingjing |
author_facet | Chen, Lingjing |
author_sort | Chen, Lingjing |
collection | PubMed |
description | Facial features are an effective representation of students' fatigue state, and the eye is more closely related to fatigue state. However, there are three main problems in the existing research: (1) the positioning of the eye is vulnerable to the external environment; (2) the ocular features need to be artificially defined and extracted for state judgment; and (3) although the student fatigue state detection based on convolutional neural network has a high accuracy, it is difficult to apply in the terminal side in real time. In view of the above problems, a method of student fatigue state judgment is proposed which combines face detection and lightweight depth learning technology. First, the AdaBoost algorithm is used to detect the human face from the input images, and the images marked with human face regions are saved to the local folder, which is used as the sample dataset of the open-close judgment part. Second, a novel reconstructed pyramid structure is proposed to improve the MobileNetV2-SSD to improve the accuracy of target detection. Then, the feature enhancement suppression mechanism based on SE-Net module is introduced to effectively improve the feature expression ability. The final experimental results show that, compared with the current commonly used target detection network, the proposed method has better classification ability for eye state and is improved in real-time performance and accuracy. |
format | Online Article Text |
id | pubmed-8548165 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | Hindawi |
record_format | MEDLINE/PubMed |
spelling | pubmed-85481652021-10-27 Evaluation Technology of Classroom Students' Learning State Based on Deep Learning Chen, Lingjing Comput Intell Neurosci Research Article Facial features are an effective representation of students' fatigue state, and the eye is more closely related to fatigue state. However, there are three main problems in the existing research: (1) the positioning of the eye is vulnerable to the external environment; (2) the ocular features need to be artificially defined and extracted for state judgment; and (3) although the student fatigue state detection based on convolutional neural network has a high accuracy, it is difficult to apply in the terminal side in real time. In view of the above problems, a method of student fatigue state judgment is proposed which combines face detection and lightweight depth learning technology. First, the AdaBoost algorithm is used to detect the human face from the input images, and the images marked with human face regions are saved to the local folder, which is used as the sample dataset of the open-close judgment part. Second, a novel reconstructed pyramid structure is proposed to improve the MobileNetV2-SSD to improve the accuracy of target detection. Then, the feature enhancement suppression mechanism based on SE-Net module is introduced to effectively improve the feature expression ability. The final experimental results show that, compared with the current commonly used target detection network, the proposed method has better classification ability for eye state and is improved in real-time performance and accuracy. Hindawi 2021-10-19 /pmc/articles/PMC8548165/ /pubmed/34712318 http://dx.doi.org/10.1155/2021/6999347 Text en Copyright © 2021 Lingjing Chen. https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. |
spellingShingle | Research Article Chen, Lingjing Evaluation Technology of Classroom Students' Learning State Based on Deep Learning |
title | Evaluation Technology of Classroom Students' Learning State Based on Deep Learning |
title_full | Evaluation Technology of Classroom Students' Learning State Based on Deep Learning |
title_fullStr | Evaluation Technology of Classroom Students' Learning State Based on Deep Learning |
title_full_unstemmed | Evaluation Technology of Classroom Students' Learning State Based on Deep Learning |
title_short | Evaluation Technology of Classroom Students' Learning State Based on Deep Learning |
title_sort | evaluation technology of classroom students' learning state based on deep learning |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8548165/ https://www.ncbi.nlm.nih.gov/pubmed/34712318 http://dx.doi.org/10.1155/2021/6999347 |
work_keys_str_mv | AT chenlingjing evaluationtechnologyofclassroomstudentslearningstatebasedondeeplearning |