Cargando…
A novel approach for yoga pose estimation based on in-depth analysis of human body joint detection accuracy
Virtual motion and pose from images and video can be estimated by detecting body joints and their interconnection. The human body has diverse and complicated poses in yoga, making its classification challenging. This study estimates yoga poses from the images using a neural network. Five different y...
Autores principales: | , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
PeerJ Inc.
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10280249/ https://www.ncbi.nlm.nih.gov/pubmed/37346636 http://dx.doi.org/10.7717/peerj-cs.1152 |
_version_ | 1785060756944846848 |
---|---|
author | Desai, Miral Mewada, Hiren |
author_facet | Desai, Miral Mewada, Hiren |
author_sort | Desai, Miral |
collection | PubMed |
description | Virtual motion and pose from images and video can be estimated by detecting body joints and their interconnection. The human body has diverse and complicated poses in yoga, making its classification challenging. This study estimates yoga poses from the images using a neural network. Five different yoga poses, viz. downdog, tree, plank, warrior2, and goddess in the form of RGB images are used as the target inputs. The BlazePose model was used to localize the body joints of the yoga poses. It detected a maximum of 33 body joints, referred to as keypoints, covering almost all the body parts. Keypoints achieved from the model are considered as predicted joint locations. True keypoints, as the ground truth body joint for individual yoga poses, are identified manually using the open source image annotation tool named Makesense AI. A detailed analysis of the body joint detection accuracy is proposed in the form of percentage of corrected keypoints (PCK) and percentage of detected joints (PDJ) for individual body parts and individual body joints, respectively. An algorithm is designed to measure PCK and PDJ in which the distance between the predicted joint location and true joint location is calculated. The experiment evaluation suggests that the adopted model obtained 93.9% PCK for the goddess pose. The maximum PCK achieved for the goddess pose, i.e., 93.9%, PDJ evaluation was carried out in the staggering mode where maximum PDJ is obtained as 90% to 100% for almost all the body joints. |
format | Online Article Text |
id | pubmed-10280249 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | PeerJ Inc. |
record_format | MEDLINE/PubMed |
spelling | pubmed-102802492023-06-21 A novel approach for yoga pose estimation based on in-depth analysis of human body joint detection accuracy Desai, Miral Mewada, Hiren PeerJ Comput Sci Human-Computer Interaction Virtual motion and pose from images and video can be estimated by detecting body joints and their interconnection. The human body has diverse and complicated poses in yoga, making its classification challenging. This study estimates yoga poses from the images using a neural network. Five different yoga poses, viz. downdog, tree, plank, warrior2, and goddess in the form of RGB images are used as the target inputs. The BlazePose model was used to localize the body joints of the yoga poses. It detected a maximum of 33 body joints, referred to as keypoints, covering almost all the body parts. Keypoints achieved from the model are considered as predicted joint locations. True keypoints, as the ground truth body joint for individual yoga poses, are identified manually using the open source image annotation tool named Makesense AI. A detailed analysis of the body joint detection accuracy is proposed in the form of percentage of corrected keypoints (PCK) and percentage of detected joints (PDJ) for individual body parts and individual body joints, respectively. An algorithm is designed to measure PCK and PDJ in which the distance between the predicted joint location and true joint location is calculated. The experiment evaluation suggests that the adopted model obtained 93.9% PCK for the goddess pose. The maximum PCK achieved for the goddess pose, i.e., 93.9%, PDJ evaluation was carried out in the staggering mode where maximum PDJ is obtained as 90% to 100% for almost all the body joints. PeerJ Inc. 2023-01-13 /pmc/articles/PMC10280249/ /pubmed/37346636 http://dx.doi.org/10.7717/peerj-cs.1152 Text en ©2023 Desai and Mewada https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, reproduction and adaptation in any medium and for any purpose provided that it is properly attributed. For attribution, the original author(s), title, publication source (PeerJ Computer Science) and either DOI or URL of the article must be cited. |
spellingShingle | Human-Computer Interaction Desai, Miral Mewada, Hiren A novel approach for yoga pose estimation based on in-depth analysis of human body joint detection accuracy |
title | A novel approach for yoga pose estimation based on in-depth analysis of human body joint detection accuracy |
title_full | A novel approach for yoga pose estimation based on in-depth analysis of human body joint detection accuracy |
title_fullStr | A novel approach for yoga pose estimation based on in-depth analysis of human body joint detection accuracy |
title_full_unstemmed | A novel approach for yoga pose estimation based on in-depth analysis of human body joint detection accuracy |
title_short | A novel approach for yoga pose estimation based on in-depth analysis of human body joint detection accuracy |
title_sort | novel approach for yoga pose estimation based on in-depth analysis of human body joint detection accuracy |
topic | Human-Computer Interaction |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10280249/ https://www.ncbi.nlm.nih.gov/pubmed/37346636 http://dx.doi.org/10.7717/peerj-cs.1152 |
work_keys_str_mv | AT desaimiral anovelapproachforyogaposeestimationbasedonindepthanalysisofhumanbodyjointdetectionaccuracy AT mewadahiren anovelapproachforyogaposeestimationbasedonindepthanalysisofhumanbodyjointdetectionaccuracy AT desaimiral novelapproachforyogaposeestimationbasedonindepthanalysisofhumanbodyjointdetectionaccuracy AT mewadahiren novelapproachforyogaposeestimationbasedonindepthanalysisofhumanbodyjointdetectionaccuracy |