Cargando…

Motion Fatigue State Detection Based on Neural Networks

Aiming at the problem of fatigue state detection at the back of sports, a cascade deep learning detection system structure is designed, and a convolutional neural network fatigue state detection model based on multiscale pooling is proposed. Firstly, face detection is carried out by a deep learning...

Descripción completa

Detalles Bibliográficos
Autores principales: Li, Hu, Wang, Yabo, Nan, Yao
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Hindawi 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8940542/
https://www.ncbi.nlm.nih.gov/pubmed/35330594
http://dx.doi.org/10.1155/2022/9602631
_version_ 1784672947645972480
author Li, Hu
Wang, Yabo
Nan, Yao
author_facet Li, Hu
Wang, Yabo
Nan, Yao
author_sort Li, Hu
collection PubMed
description Aiming at the problem of fatigue state detection at the back of sports, a cascade deep learning detection system structure is designed, and a convolutional neural network fatigue state detection model based on multiscale pooling is proposed. Firstly, face detection is carried out by a deep learning model MTCNN to extract eye and mouth regions. Aiming at the problem of eye and mouth state representation and recognition, a multiscale pooling model (MSP) based on RESNET  is proposed to train the eye and mouth state. In real-time detection, the state of the eye and mouth region is recognized through the trained convolution neural network model. Finally, the athlete's fatigue is determined based on PERCLOS and the proposed mouth opening and closing frequency (FOM). The experimental results show that in the training process, we set the batch_size = 100 and the initial learning rate = 0.01. When the evaluation index is no longer improved, the learning rate is reduced by 10 times to 0.001, and a total of 50 epochs are trained. The precision and recall of the system are high. Compared with the infrared image simulating the night state, the RGB image taken by the ordinary camera in the daytime has higher precision and recall. It is proven that the neural network has high detection accuracy, meets the real-time requirements, and has high robustness in complex environments.
format Online
Article
Text
id pubmed-8940542
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Hindawi
record_format MEDLINE/PubMed
spelling pubmed-89405422022-03-23 Motion Fatigue State Detection Based on Neural Networks Li, Hu Wang, Yabo Nan, Yao Comput Intell Neurosci Research Article Aiming at the problem of fatigue state detection at the back of sports, a cascade deep learning detection system structure is designed, and a convolutional neural network fatigue state detection model based on multiscale pooling is proposed. Firstly, face detection is carried out by a deep learning model MTCNN to extract eye and mouth regions. Aiming at the problem of eye and mouth state representation and recognition, a multiscale pooling model (MSP) based on RESNET  is proposed to train the eye and mouth state. In real-time detection, the state of the eye and mouth region is recognized through the trained convolution neural network model. Finally, the athlete's fatigue is determined based on PERCLOS and the proposed mouth opening and closing frequency (FOM). The experimental results show that in the training process, we set the batch_size = 100 and the initial learning rate = 0.01. When the evaluation index is no longer improved, the learning rate is reduced by 10 times to 0.001, and a total of 50 epochs are trained. The precision and recall of the system are high. Compared with the infrared image simulating the night state, the RGB image taken by the ordinary camera in the daytime has higher precision and recall. It is proven that the neural network has high detection accuracy, meets the real-time requirements, and has high robustness in complex environments. Hindawi 2022-03-15 /pmc/articles/PMC8940542/ /pubmed/35330594 http://dx.doi.org/10.1155/2022/9602631 Text en Copyright © 2022 Hu Li et al. https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Research Article
Li, Hu
Wang, Yabo
Nan, Yao
Motion Fatigue State Detection Based on Neural Networks
title Motion Fatigue State Detection Based on Neural Networks
title_full Motion Fatigue State Detection Based on Neural Networks
title_fullStr Motion Fatigue State Detection Based on Neural Networks
title_full_unstemmed Motion Fatigue State Detection Based on Neural Networks
title_short Motion Fatigue State Detection Based on Neural Networks
title_sort motion fatigue state detection based on neural networks
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8940542/
https://www.ncbi.nlm.nih.gov/pubmed/35330594
http://dx.doi.org/10.1155/2022/9602631
work_keys_str_mv AT lihu motionfatiguestatedetectionbasedonneuralnetworks
AT wangyabo motionfatiguestatedetectionbasedonneuralnetworks
AT nanyao motionfatiguestatedetectionbasedonneuralnetworks