Cargando…

Lightweight Deep Neural Network Embedded with Stochastic Variational Inference Loss Function for Fast Detection of Human Postures

Fusing object detection techniques and stochastic variational inference, we proposed a new scheme for lightweight neural network models, which could simultaneously reduce model sizes and raise the inference speed. This technique was then applied in fast human posture identification. The integer-arit...

Descripción completa

Detalles Bibliográficos
Autores principales: Hsu, Feng-Shuo, Su, Zi-Jun, Kao, Yamin, Tsai, Sen-Wei, Lin, Ying-Chao, Tu, Po-Hsun, Gong, Cihun-Siyong Alex, Chen, Chien-Chang
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9955849/
https://www.ncbi.nlm.nih.gov/pubmed/36832702
http://dx.doi.org/10.3390/e25020336
_version_ 1784894448129277952
author Hsu, Feng-Shuo
Su, Zi-Jun
Kao, Yamin
Tsai, Sen-Wei
Lin, Ying-Chao
Tu, Po-Hsun
Gong, Cihun-Siyong Alex
Chen, Chien-Chang
author_facet Hsu, Feng-Shuo
Su, Zi-Jun
Kao, Yamin
Tsai, Sen-Wei
Lin, Ying-Chao
Tu, Po-Hsun
Gong, Cihun-Siyong Alex
Chen, Chien-Chang
author_sort Hsu, Feng-Shuo
collection PubMed
description Fusing object detection techniques and stochastic variational inference, we proposed a new scheme for lightweight neural network models, which could simultaneously reduce model sizes and raise the inference speed. This technique was then applied in fast human posture identification. The integer-arithmetic-only algorithm and the feature pyramid network were adopted to reduce the computational complexity in training and to capture features of small objects, respectively. Features of sequential human motion frames (i.e., the centroid coordinates of bounding boxes) were extracted by the self-attention mechanism. With the techniques of Bayesian neural network and stochastic variational inference, human postures could be promptly classified by fast resolving of the Gaussian mixture model for human posture classification. The model took instant centroid features as inputs and indicated possible human postures in the probabilistic maps. Our model had better overall performance than the baseline model ResNet in mean average precision (32.5 vs. 34.6), inference speed (27 vs. 48 milliseconds), and model size (46.2 vs. 227.8 MB). The model could also alert a suspected human falling event about 0.66 s in advance.
format Online
Article
Text
id pubmed-9955849
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-99558492023-02-25 Lightweight Deep Neural Network Embedded with Stochastic Variational Inference Loss Function for Fast Detection of Human Postures Hsu, Feng-Shuo Su, Zi-Jun Kao, Yamin Tsai, Sen-Wei Lin, Ying-Chao Tu, Po-Hsun Gong, Cihun-Siyong Alex Chen, Chien-Chang Entropy (Basel) Article Fusing object detection techniques and stochastic variational inference, we proposed a new scheme for lightweight neural network models, which could simultaneously reduce model sizes and raise the inference speed. This technique was then applied in fast human posture identification. The integer-arithmetic-only algorithm and the feature pyramid network were adopted to reduce the computational complexity in training and to capture features of small objects, respectively. Features of sequential human motion frames (i.e., the centroid coordinates of bounding boxes) were extracted by the self-attention mechanism. With the techniques of Bayesian neural network and stochastic variational inference, human postures could be promptly classified by fast resolving of the Gaussian mixture model for human posture classification. The model took instant centroid features as inputs and indicated possible human postures in the probabilistic maps. Our model had better overall performance than the baseline model ResNet in mean average precision (32.5 vs. 34.6), inference speed (27 vs. 48 milliseconds), and model size (46.2 vs. 227.8 MB). The model could also alert a suspected human falling event about 0.66 s in advance. MDPI 2023-02-11 /pmc/articles/PMC9955849/ /pubmed/36832702 http://dx.doi.org/10.3390/e25020336 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Hsu, Feng-Shuo
Su, Zi-Jun
Kao, Yamin
Tsai, Sen-Wei
Lin, Ying-Chao
Tu, Po-Hsun
Gong, Cihun-Siyong Alex
Chen, Chien-Chang
Lightweight Deep Neural Network Embedded with Stochastic Variational Inference Loss Function for Fast Detection of Human Postures
title Lightweight Deep Neural Network Embedded with Stochastic Variational Inference Loss Function for Fast Detection of Human Postures
title_full Lightweight Deep Neural Network Embedded with Stochastic Variational Inference Loss Function for Fast Detection of Human Postures
title_fullStr Lightweight Deep Neural Network Embedded with Stochastic Variational Inference Loss Function for Fast Detection of Human Postures
title_full_unstemmed Lightweight Deep Neural Network Embedded with Stochastic Variational Inference Loss Function for Fast Detection of Human Postures
title_short Lightweight Deep Neural Network Embedded with Stochastic Variational Inference Loss Function for Fast Detection of Human Postures
title_sort lightweight deep neural network embedded with stochastic variational inference loss function for fast detection of human postures
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9955849/
https://www.ncbi.nlm.nih.gov/pubmed/36832702
http://dx.doi.org/10.3390/e25020336
work_keys_str_mv AT hsufengshuo lightweightdeepneuralnetworkembeddedwithstochasticvariationalinferencelossfunctionforfastdetectionofhumanpostures
AT suzijun lightweightdeepneuralnetworkembeddedwithstochasticvariationalinferencelossfunctionforfastdetectionofhumanpostures
AT kaoyamin lightweightdeepneuralnetworkembeddedwithstochasticvariationalinferencelossfunctionforfastdetectionofhumanpostures
AT tsaisenwei lightweightdeepneuralnetworkembeddedwithstochasticvariationalinferencelossfunctionforfastdetectionofhumanpostures
AT linyingchao lightweightdeepneuralnetworkembeddedwithstochasticvariationalinferencelossfunctionforfastdetectionofhumanpostures
AT tupohsun lightweightdeepneuralnetworkembeddedwithstochasticvariationalinferencelossfunctionforfastdetectionofhumanpostures
AT gongcihunsiyongalex lightweightdeepneuralnetworkembeddedwithstochasticvariationalinferencelossfunctionforfastdetectionofhumanpostures
AT chenchienchang lightweightdeepneuralnetworkembeddedwithstochasticvariationalinferencelossfunctionforfastdetectionofhumanpostures