Cargando…
Sleep Action Recognition Based on Segmentation Strategy
In order to solve the problem of long video dependence and the difficulty of fine-grained feature extraction in the video behavior recognition of personnel sleeping at a security-monitored scene, this paper proposes a time-series convolution-network-based sleeping behavior recognition algorithm suit...
Autores principales: | , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10051268/ https://www.ncbi.nlm.nih.gov/pubmed/36976111 http://dx.doi.org/10.3390/jimaging9030060 |
_version_ | 1785014842952777728 |
---|---|
author | Zhou, Xiang Cui, Yue Xu, Gang Chen, Hongliang Zeng, Jing Li, Yutong Xiao, Jiangjian |
author_facet | Zhou, Xiang Cui, Yue Xu, Gang Chen, Hongliang Zeng, Jing Li, Yutong Xiao, Jiangjian |
author_sort | Zhou, Xiang |
collection | PubMed |
description | In order to solve the problem of long video dependence and the difficulty of fine-grained feature extraction in the video behavior recognition of personnel sleeping at a security-monitored scene, this paper proposes a time-series convolution-network-based sleeping behavior recognition algorithm suitable for monitoring data. ResNet50 is selected as the backbone network, and the self-attention coding layer is used to extract rich contextual semantic information; then, a segment-level feature fusion module is constructed to enhance the effective transmission of important information in the segment feature sequence on the network, and the long-term memory network is used to model the entire video in the time dimension to improve behavior detection ability. This paper constructs a data set of sleeping behavior under security monitoring, and the two behaviors contain about 2800 single-person target videos. The experimental results show that the detection accuracy of the network model in this paper is significantly improved on the sleeping post data set, up to 6.69% higher than the benchmark network. Compared with other network models, the performance of the algorithm in this paper has improved to different degrees and has good application value. |
format | Online Article Text |
id | pubmed-10051268 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-100512682023-03-30 Sleep Action Recognition Based on Segmentation Strategy Zhou, Xiang Cui, Yue Xu, Gang Chen, Hongliang Zeng, Jing Li, Yutong Xiao, Jiangjian J Imaging Article In order to solve the problem of long video dependence and the difficulty of fine-grained feature extraction in the video behavior recognition of personnel sleeping at a security-monitored scene, this paper proposes a time-series convolution-network-based sleeping behavior recognition algorithm suitable for monitoring data. ResNet50 is selected as the backbone network, and the self-attention coding layer is used to extract rich contextual semantic information; then, a segment-level feature fusion module is constructed to enhance the effective transmission of important information in the segment feature sequence on the network, and the long-term memory network is used to model the entire video in the time dimension to improve behavior detection ability. This paper constructs a data set of sleeping behavior under security monitoring, and the two behaviors contain about 2800 single-person target videos. The experimental results show that the detection accuracy of the network model in this paper is significantly improved on the sleeping post data set, up to 6.69% higher than the benchmark network. Compared with other network models, the performance of the algorithm in this paper has improved to different degrees and has good application value. MDPI 2023-03-07 /pmc/articles/PMC10051268/ /pubmed/36976111 http://dx.doi.org/10.3390/jimaging9030060 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Zhou, Xiang Cui, Yue Xu, Gang Chen, Hongliang Zeng, Jing Li, Yutong Xiao, Jiangjian Sleep Action Recognition Based on Segmentation Strategy |
title | Sleep Action Recognition Based on Segmentation Strategy |
title_full | Sleep Action Recognition Based on Segmentation Strategy |
title_fullStr | Sleep Action Recognition Based on Segmentation Strategy |
title_full_unstemmed | Sleep Action Recognition Based on Segmentation Strategy |
title_short | Sleep Action Recognition Based on Segmentation Strategy |
title_sort | sleep action recognition based on segmentation strategy |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10051268/ https://www.ncbi.nlm.nih.gov/pubmed/36976111 http://dx.doi.org/10.3390/jimaging9030060 |
work_keys_str_mv | AT zhouxiang sleepactionrecognitionbasedonsegmentationstrategy AT cuiyue sleepactionrecognitionbasedonsegmentationstrategy AT xugang sleepactionrecognitionbasedonsegmentationstrategy AT chenhongliang sleepactionrecognitionbasedonsegmentationstrategy AT zengjing sleepactionrecognitionbasedonsegmentationstrategy AT liyutong sleepactionrecognitionbasedonsegmentationstrategy AT xiaojiangjian sleepactionrecognitionbasedonsegmentationstrategy |