Cargando…

Sleep Action Recognition Based on Segmentation Strategy

In order to solve the problem of long video dependence and the difficulty of fine-grained feature extraction in the video behavior recognition of personnel sleeping at a security-monitored scene, this paper proposes a time-series convolution-network-based sleeping behavior recognition algorithm suit...

Descripción completa

Detalles Bibliográficos
Autores principales: Zhou, Xiang, Cui, Yue, Xu, Gang, Chen, Hongliang, Zeng, Jing, Li, Yutong, Xiao, Jiangjian
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10051268/
https://www.ncbi.nlm.nih.gov/pubmed/36976111
http://dx.doi.org/10.3390/jimaging9030060
_version_ 1785014842952777728
author Zhou, Xiang
Cui, Yue
Xu, Gang
Chen, Hongliang
Zeng, Jing
Li, Yutong
Xiao, Jiangjian
author_facet Zhou, Xiang
Cui, Yue
Xu, Gang
Chen, Hongliang
Zeng, Jing
Li, Yutong
Xiao, Jiangjian
author_sort Zhou, Xiang
collection PubMed
description In order to solve the problem of long video dependence and the difficulty of fine-grained feature extraction in the video behavior recognition of personnel sleeping at a security-monitored scene, this paper proposes a time-series convolution-network-based sleeping behavior recognition algorithm suitable for monitoring data. ResNet50 is selected as the backbone network, and the self-attention coding layer is used to extract rich contextual semantic information; then, a segment-level feature fusion module is constructed to enhance the effective transmission of important information in the segment feature sequence on the network, and the long-term memory network is used to model the entire video in the time dimension to improve behavior detection ability. This paper constructs a data set of sleeping behavior under security monitoring, and the two behaviors contain about 2800 single-person target videos. The experimental results show that the detection accuracy of the network model in this paper is significantly improved on the sleeping post data set, up to 6.69% higher than the benchmark network. Compared with other network models, the performance of the algorithm in this paper has improved to different degrees and has good application value.
format Online
Article
Text
id pubmed-10051268
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-100512682023-03-30 Sleep Action Recognition Based on Segmentation Strategy Zhou, Xiang Cui, Yue Xu, Gang Chen, Hongliang Zeng, Jing Li, Yutong Xiao, Jiangjian J Imaging Article In order to solve the problem of long video dependence and the difficulty of fine-grained feature extraction in the video behavior recognition of personnel sleeping at a security-monitored scene, this paper proposes a time-series convolution-network-based sleeping behavior recognition algorithm suitable for monitoring data. ResNet50 is selected as the backbone network, and the self-attention coding layer is used to extract rich contextual semantic information; then, a segment-level feature fusion module is constructed to enhance the effective transmission of important information in the segment feature sequence on the network, and the long-term memory network is used to model the entire video in the time dimension to improve behavior detection ability. This paper constructs a data set of sleeping behavior under security monitoring, and the two behaviors contain about 2800 single-person target videos. The experimental results show that the detection accuracy of the network model in this paper is significantly improved on the sleeping post data set, up to 6.69% higher than the benchmark network. Compared with other network models, the performance of the algorithm in this paper has improved to different degrees and has good application value. MDPI 2023-03-07 /pmc/articles/PMC10051268/ /pubmed/36976111 http://dx.doi.org/10.3390/jimaging9030060 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Zhou, Xiang
Cui, Yue
Xu, Gang
Chen, Hongliang
Zeng, Jing
Li, Yutong
Xiao, Jiangjian
Sleep Action Recognition Based on Segmentation Strategy
title Sleep Action Recognition Based on Segmentation Strategy
title_full Sleep Action Recognition Based on Segmentation Strategy
title_fullStr Sleep Action Recognition Based on Segmentation Strategy
title_full_unstemmed Sleep Action Recognition Based on Segmentation Strategy
title_short Sleep Action Recognition Based on Segmentation Strategy
title_sort sleep action recognition based on segmentation strategy
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10051268/
https://www.ncbi.nlm.nih.gov/pubmed/36976111
http://dx.doi.org/10.3390/jimaging9030060
work_keys_str_mv AT zhouxiang sleepactionrecognitionbasedonsegmentationstrategy
AT cuiyue sleepactionrecognitionbasedonsegmentationstrategy
AT xugang sleepactionrecognitionbasedonsegmentationstrategy
AT chenhongliang sleepactionrecognitionbasedonsegmentationstrategy
AT zengjing sleepactionrecognitionbasedonsegmentationstrategy
AT liyutong sleepactionrecognitionbasedonsegmentationstrategy
AT xiaojiangjian sleepactionrecognitionbasedonsegmentationstrategy