Cargando…

An effective behavior recognition method in the video session using convolutional neural network

In order to further improve the accuracy of the video-based behavior recognition method, an effective behavior recognition method in the video session using convolutional neural network is proposed. Specifically, by adding the target detection phase before the behavior recognition algorithm, the bod...

Descripción completa

Detalles Bibliográficos
Autores principales: Meng, Yizhen, Zhang, Jun
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9342725/
https://www.ncbi.nlm.nih.gov/pubmed/35913982
http://dx.doi.org/10.1371/journal.pone.0266734
_version_ 1784760886227894272
author Meng, Yizhen
Zhang, Jun
author_facet Meng, Yizhen
Zhang, Jun
author_sort Meng, Yizhen
collection PubMed
description In order to further improve the accuracy of the video-based behavior recognition method, an effective behavior recognition method in the video session using convolutional neural network is proposed. Specifically, by adding the target detection phase before the behavior recognition algorithm, the body region in the video can be accurately extracted to reduce the interference of redundant and unnecessary background noises, and at the same time, the inappropriate images can be replaced, which has reached the role of balance background trade-off, and finally, the neural network can learn the human behavior information with emphasis. By adding fragmentation and stochastic sampling, the long-time time-domain modeling of the whole video session can be established, so that the model can obtain video-level expression ability. Finally, the improved loss function is used for behavior recognition to solve the problem of classification difficulty and possible sample imbalance. In addition, we conducted the hyperparametric experiment, the ablation experiment and the contrast experiment on different open source and benchmark datasets. Compared with other commonly used behavior recognition algorithms, the experimental results verify the effectiveness of the proposed method. In addition, the related deep learning-based methods used in behavior recognition are reviewed at the beginning of this paper, and the challenges in behavior recognition and future research directions are prospected at the end of this paper, which will undoubtedly play a double role in the work of later researchers.
format Online
Article
Text
id pubmed-9342725
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-93427252022-08-02 An effective behavior recognition method in the video session using convolutional neural network Meng, Yizhen Zhang, Jun PLoS One Research Article In order to further improve the accuracy of the video-based behavior recognition method, an effective behavior recognition method in the video session using convolutional neural network is proposed. Specifically, by adding the target detection phase before the behavior recognition algorithm, the body region in the video can be accurately extracted to reduce the interference of redundant and unnecessary background noises, and at the same time, the inappropriate images can be replaced, which has reached the role of balance background trade-off, and finally, the neural network can learn the human behavior information with emphasis. By adding fragmentation and stochastic sampling, the long-time time-domain modeling of the whole video session can be established, so that the model can obtain video-level expression ability. Finally, the improved loss function is used for behavior recognition to solve the problem of classification difficulty and possible sample imbalance. In addition, we conducted the hyperparametric experiment, the ablation experiment and the contrast experiment on different open source and benchmark datasets. Compared with other commonly used behavior recognition algorithms, the experimental results verify the effectiveness of the proposed method. In addition, the related deep learning-based methods used in behavior recognition are reviewed at the beginning of this paper, and the challenges in behavior recognition and future research directions are prospected at the end of this paper, which will undoubtedly play a double role in the work of later researchers. Public Library of Science 2022-08-01 /pmc/articles/PMC9342725/ /pubmed/35913982 http://dx.doi.org/10.1371/journal.pone.0266734 Text en © 2022 Meng, Zhang https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Research Article
Meng, Yizhen
Zhang, Jun
An effective behavior recognition method in the video session using convolutional neural network
title An effective behavior recognition method in the video session using convolutional neural network
title_full An effective behavior recognition method in the video session using convolutional neural network
title_fullStr An effective behavior recognition method in the video session using convolutional neural network
title_full_unstemmed An effective behavior recognition method in the video session using convolutional neural network
title_short An effective behavior recognition method in the video session using convolutional neural network
title_sort effective behavior recognition method in the video session using convolutional neural network
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9342725/
https://www.ncbi.nlm.nih.gov/pubmed/35913982
http://dx.doi.org/10.1371/journal.pone.0266734
work_keys_str_mv AT mengyizhen aneffectivebehaviorrecognitionmethodinthevideosessionusingconvolutionalneuralnetwork
AT zhangjun aneffectivebehaviorrecognitionmethodinthevideosessionusingconvolutionalneuralnetwork
AT mengyizhen effectivebehaviorrecognitionmethodinthevideosessionusingconvolutionalneuralnetwork
AT zhangjun effectivebehaviorrecognitionmethodinthevideosessionusingconvolutionalneuralnetwork