Cargando…

A novel approach for yoga pose estimation based on in-depth analysis of human body joint detection accuracy

Virtual motion and pose from images and video can be estimated by detecting body joints and their interconnection. The human body has diverse and complicated poses in yoga, making its classification challenging. This study estimates yoga poses from the images using a neural network. Five different y...

Descripción completa

Detalles Bibliográficos
Autores principales: Desai, Miral, Mewada, Hiren
Formato: Online Artículo Texto
Lenguaje:English
Publicado: PeerJ Inc. 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10280249/
https://www.ncbi.nlm.nih.gov/pubmed/37346636
http://dx.doi.org/10.7717/peerj-cs.1152
_version_ 1785060756944846848
author Desai, Miral
Mewada, Hiren
author_facet Desai, Miral
Mewada, Hiren
author_sort Desai, Miral
collection PubMed
description Virtual motion and pose from images and video can be estimated by detecting body joints and their interconnection. The human body has diverse and complicated poses in yoga, making its classification challenging. This study estimates yoga poses from the images using a neural network. Five different yoga poses, viz. downdog, tree, plank, warrior2, and goddess in the form of RGB images are used as the target inputs. The BlazePose model was used to localize the body joints of the yoga poses. It detected a maximum of 33 body joints, referred to as keypoints, covering almost all the body parts. Keypoints achieved from the model are considered as predicted joint locations. True keypoints, as the ground truth body joint for individual yoga poses, are identified manually using the open source image annotation tool named Makesense AI. A detailed analysis of the body joint detection accuracy is proposed in the form of percentage of corrected keypoints (PCK) and percentage of detected joints (PDJ) for individual body parts and individual body joints, respectively. An algorithm is designed to measure PCK and PDJ in which the distance between the predicted joint location and true joint location is calculated. The experiment evaluation suggests that the adopted model obtained 93.9% PCK for the goddess pose. The maximum PCK achieved for the goddess pose, i.e., 93.9%, PDJ evaluation was carried out in the staggering mode where maximum PDJ is obtained as 90% to 100% for almost all the body joints.
format Online
Article
Text
id pubmed-10280249
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher PeerJ Inc.
record_format MEDLINE/PubMed
spelling pubmed-102802492023-06-21 A novel approach for yoga pose estimation based on in-depth analysis of human body joint detection accuracy Desai, Miral Mewada, Hiren PeerJ Comput Sci Human-Computer Interaction Virtual motion and pose from images and video can be estimated by detecting body joints and their interconnection. The human body has diverse and complicated poses in yoga, making its classification challenging. This study estimates yoga poses from the images using a neural network. Five different yoga poses, viz. downdog, tree, plank, warrior2, and goddess in the form of RGB images are used as the target inputs. The BlazePose model was used to localize the body joints of the yoga poses. It detected a maximum of 33 body joints, referred to as keypoints, covering almost all the body parts. Keypoints achieved from the model are considered as predicted joint locations. True keypoints, as the ground truth body joint for individual yoga poses, are identified manually using the open source image annotation tool named Makesense AI. A detailed analysis of the body joint detection accuracy is proposed in the form of percentage of corrected keypoints (PCK) and percentage of detected joints (PDJ) for individual body parts and individual body joints, respectively. An algorithm is designed to measure PCK and PDJ in which the distance between the predicted joint location and true joint location is calculated. The experiment evaluation suggests that the adopted model obtained 93.9% PCK for the goddess pose. The maximum PCK achieved for the goddess pose, i.e., 93.9%, PDJ evaluation was carried out in the staggering mode where maximum PDJ is obtained as 90% to 100% for almost all the body joints. PeerJ Inc. 2023-01-13 /pmc/articles/PMC10280249/ /pubmed/37346636 http://dx.doi.org/10.7717/peerj-cs.1152 Text en ©2023 Desai and Mewada https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, reproduction and adaptation in any medium and for any purpose provided that it is properly attributed. For attribution, the original author(s), title, publication source (PeerJ Computer Science) and either DOI or URL of the article must be cited.
spellingShingle Human-Computer Interaction
Desai, Miral
Mewada, Hiren
A novel approach for yoga pose estimation based on in-depth analysis of human body joint detection accuracy
title A novel approach for yoga pose estimation based on in-depth analysis of human body joint detection accuracy
title_full A novel approach for yoga pose estimation based on in-depth analysis of human body joint detection accuracy
title_fullStr A novel approach for yoga pose estimation based on in-depth analysis of human body joint detection accuracy
title_full_unstemmed A novel approach for yoga pose estimation based on in-depth analysis of human body joint detection accuracy
title_short A novel approach for yoga pose estimation based on in-depth analysis of human body joint detection accuracy
title_sort novel approach for yoga pose estimation based on in-depth analysis of human body joint detection accuracy
topic Human-Computer Interaction
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10280249/
https://www.ncbi.nlm.nih.gov/pubmed/37346636
http://dx.doi.org/10.7717/peerj-cs.1152
work_keys_str_mv AT desaimiral anovelapproachforyogaposeestimationbasedonindepthanalysisofhumanbodyjointdetectionaccuracy
AT mewadahiren anovelapproachforyogaposeestimationbasedonindepthanalysisofhumanbodyjointdetectionaccuracy
AT desaimiral novelapproachforyogaposeestimationbasedonindepthanalysisofhumanbodyjointdetectionaccuracy
AT mewadahiren novelapproachforyogaposeestimationbasedonindepthanalysisofhumanbodyjointdetectionaccuracy