Cargando…
An effective behavior recognition method in the video session using convolutional neural network
In order to further improve the accuracy of the video-based behavior recognition method, an effective behavior recognition method in the video session using convolutional neural network is proposed. Specifically, by adding the target detection phase before the behavior recognition algorithm, the bod...
Autores principales: | , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Public Library of Science
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9342725/ https://www.ncbi.nlm.nih.gov/pubmed/35913982 http://dx.doi.org/10.1371/journal.pone.0266734 |
_version_ | 1784760886227894272 |
---|---|
author | Meng, Yizhen Zhang, Jun |
author_facet | Meng, Yizhen Zhang, Jun |
author_sort | Meng, Yizhen |
collection | PubMed |
description | In order to further improve the accuracy of the video-based behavior recognition method, an effective behavior recognition method in the video session using convolutional neural network is proposed. Specifically, by adding the target detection phase before the behavior recognition algorithm, the body region in the video can be accurately extracted to reduce the interference of redundant and unnecessary background noises, and at the same time, the inappropriate images can be replaced, which has reached the role of balance background trade-off, and finally, the neural network can learn the human behavior information with emphasis. By adding fragmentation and stochastic sampling, the long-time time-domain modeling of the whole video session can be established, so that the model can obtain video-level expression ability. Finally, the improved loss function is used for behavior recognition to solve the problem of classification difficulty and possible sample imbalance. In addition, we conducted the hyperparametric experiment, the ablation experiment and the contrast experiment on different open source and benchmark datasets. Compared with other commonly used behavior recognition algorithms, the experimental results verify the effectiveness of the proposed method. In addition, the related deep learning-based methods used in behavior recognition are reviewed at the beginning of this paper, and the challenges in behavior recognition and future research directions are prospected at the end of this paper, which will undoubtedly play a double role in the work of later researchers. |
format | Online Article Text |
id | pubmed-9342725 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Public Library of Science |
record_format | MEDLINE/PubMed |
spelling | pubmed-93427252022-08-02 An effective behavior recognition method in the video session using convolutional neural network Meng, Yizhen Zhang, Jun PLoS One Research Article In order to further improve the accuracy of the video-based behavior recognition method, an effective behavior recognition method in the video session using convolutional neural network is proposed. Specifically, by adding the target detection phase before the behavior recognition algorithm, the body region in the video can be accurately extracted to reduce the interference of redundant and unnecessary background noises, and at the same time, the inappropriate images can be replaced, which has reached the role of balance background trade-off, and finally, the neural network can learn the human behavior information with emphasis. By adding fragmentation and stochastic sampling, the long-time time-domain modeling of the whole video session can be established, so that the model can obtain video-level expression ability. Finally, the improved loss function is used for behavior recognition to solve the problem of classification difficulty and possible sample imbalance. In addition, we conducted the hyperparametric experiment, the ablation experiment and the contrast experiment on different open source and benchmark datasets. Compared with other commonly used behavior recognition algorithms, the experimental results verify the effectiveness of the proposed method. In addition, the related deep learning-based methods used in behavior recognition are reviewed at the beginning of this paper, and the challenges in behavior recognition and future research directions are prospected at the end of this paper, which will undoubtedly play a double role in the work of later researchers. Public Library of Science 2022-08-01 /pmc/articles/PMC9342725/ /pubmed/35913982 http://dx.doi.org/10.1371/journal.pone.0266734 Text en © 2022 Meng, Zhang https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. |
spellingShingle | Research Article Meng, Yizhen Zhang, Jun An effective behavior recognition method in the video session using convolutional neural network |
title | An effective behavior recognition method in the video session using convolutional neural network |
title_full | An effective behavior recognition method in the video session using convolutional neural network |
title_fullStr | An effective behavior recognition method in the video session using convolutional neural network |
title_full_unstemmed | An effective behavior recognition method in the video session using convolutional neural network |
title_short | An effective behavior recognition method in the video session using convolutional neural network |
title_sort | effective behavior recognition method in the video session using convolutional neural network |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9342725/ https://www.ncbi.nlm.nih.gov/pubmed/35913982 http://dx.doi.org/10.1371/journal.pone.0266734 |
work_keys_str_mv | AT mengyizhen aneffectivebehaviorrecognitionmethodinthevideosessionusingconvolutionalneuralnetwork AT zhangjun aneffectivebehaviorrecognitionmethodinthevideosessionusingconvolutionalneuralnetwork AT mengyizhen effectivebehaviorrecognitionmethodinthevideosessionusingconvolutionalneuralnetwork AT zhangjun effectivebehaviorrecognitionmethodinthevideosessionusingconvolutionalneuralnetwork |