Cargando…
Evaluation of 3D Markerless Motion Capture Accuracy Using OpenPose With Multiple Video Cameras
There is a need within human movement sciences for a markerless motion capture system, which is easy to use and sufficiently accurate to evaluate motor performance. This study aims to develop a 3D markerless motion capture technique, using OpenPose with multiple synchronized video cameras, and exami...
Autores principales: | , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2020
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7739760/ https://www.ncbi.nlm.nih.gov/pubmed/33345042 http://dx.doi.org/10.3389/fspor.2020.00050 |
_version_ | 1783623392961757184 |
---|---|
author | Nakano, Nobuyasu Sakura, Tetsuro Ueda, Kazuhiro Omura, Leon Kimura, Arata Iino, Yoichi Fukashiro, Senshi Yoshioka, Shinsuke |
author_facet | Nakano, Nobuyasu Sakura, Tetsuro Ueda, Kazuhiro Omura, Leon Kimura, Arata Iino, Yoichi Fukashiro, Senshi Yoshioka, Shinsuke |
author_sort | Nakano, Nobuyasu |
collection | PubMed |
description | There is a need within human movement sciences for a markerless motion capture system, which is easy to use and sufficiently accurate to evaluate motor performance. This study aims to develop a 3D markerless motion capture technique, using OpenPose with multiple synchronized video cameras, and examine its accuracy in comparison with optical marker-based motion capture. Participants performed three motor tasks (walking, countermovement jumping, and ball throwing), and these movements measured using both marker-based optical motion capture and OpenPose-based markerless motion capture. The differences in corresponding joint positions, estimated from the two different methods throughout the analysis, were presented as a mean absolute error (MAE). The results demonstrated that, qualitatively, 3D pose estimation using markerless motion capture could correctly reproduce the movements of participants. Quantitatively, of all the mean absolute errors calculated, approximately 47% were <20 mm, and 80% were <30 mm. However, 10% were >40 mm. The primary reason for mean absolute errors exceeding 40 mm was that OpenPose failed to track the participant's pose in 2D images owing to failures, such as recognition of an object as a human body segment or replacing one segment with another depending on the image of each frame. In conclusion, this study demonstrates that, if an algorithm that corrects all apparently wrong tracking can be incorporated into the system, OpenPose-based markerless motion capture can be used for human movement science with an accuracy of 30 mm or less. |
format | Online Article Text |
id | pubmed-7739760 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2020 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-77397602020-12-17 Evaluation of 3D Markerless Motion Capture Accuracy Using OpenPose With Multiple Video Cameras Nakano, Nobuyasu Sakura, Tetsuro Ueda, Kazuhiro Omura, Leon Kimura, Arata Iino, Yoichi Fukashiro, Senshi Yoshioka, Shinsuke Front Sports Act Living Sports and Active Living There is a need within human movement sciences for a markerless motion capture system, which is easy to use and sufficiently accurate to evaluate motor performance. This study aims to develop a 3D markerless motion capture technique, using OpenPose with multiple synchronized video cameras, and examine its accuracy in comparison with optical marker-based motion capture. Participants performed three motor tasks (walking, countermovement jumping, and ball throwing), and these movements measured using both marker-based optical motion capture and OpenPose-based markerless motion capture. The differences in corresponding joint positions, estimated from the two different methods throughout the analysis, were presented as a mean absolute error (MAE). The results demonstrated that, qualitatively, 3D pose estimation using markerless motion capture could correctly reproduce the movements of participants. Quantitatively, of all the mean absolute errors calculated, approximately 47% were <20 mm, and 80% were <30 mm. However, 10% were >40 mm. The primary reason for mean absolute errors exceeding 40 mm was that OpenPose failed to track the participant's pose in 2D images owing to failures, such as recognition of an object as a human body segment or replacing one segment with another depending on the image of each frame. In conclusion, this study demonstrates that, if an algorithm that corrects all apparently wrong tracking can be incorporated into the system, OpenPose-based markerless motion capture can be used for human movement science with an accuracy of 30 mm or less. Frontiers Media S.A. 2020-05-27 /pmc/articles/PMC7739760/ /pubmed/33345042 http://dx.doi.org/10.3389/fspor.2020.00050 Text en Copyright © 2020 Nakano, Sakura, Ueda, Omura, Kimura, Iino, Fukashiro and Yoshioka. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Sports and Active Living Nakano, Nobuyasu Sakura, Tetsuro Ueda, Kazuhiro Omura, Leon Kimura, Arata Iino, Yoichi Fukashiro, Senshi Yoshioka, Shinsuke Evaluation of 3D Markerless Motion Capture Accuracy Using OpenPose With Multiple Video Cameras |
title | Evaluation of 3D Markerless Motion Capture Accuracy Using OpenPose With Multiple Video Cameras |
title_full | Evaluation of 3D Markerless Motion Capture Accuracy Using OpenPose With Multiple Video Cameras |
title_fullStr | Evaluation of 3D Markerless Motion Capture Accuracy Using OpenPose With Multiple Video Cameras |
title_full_unstemmed | Evaluation of 3D Markerless Motion Capture Accuracy Using OpenPose With Multiple Video Cameras |
title_short | Evaluation of 3D Markerless Motion Capture Accuracy Using OpenPose With Multiple Video Cameras |
title_sort | evaluation of 3d markerless motion capture accuracy using openpose with multiple video cameras |
topic | Sports and Active Living |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7739760/ https://www.ncbi.nlm.nih.gov/pubmed/33345042 http://dx.doi.org/10.3389/fspor.2020.00050 |
work_keys_str_mv | AT nakanonobuyasu evaluationof3dmarkerlessmotioncaptureaccuracyusingopenposewithmultiplevideocameras AT sakuratetsuro evaluationof3dmarkerlessmotioncaptureaccuracyusingopenposewithmultiplevideocameras AT uedakazuhiro evaluationof3dmarkerlessmotioncaptureaccuracyusingopenposewithmultiplevideocameras AT omuraleon evaluationof3dmarkerlessmotioncaptureaccuracyusingopenposewithmultiplevideocameras AT kimuraarata evaluationof3dmarkerlessmotioncaptureaccuracyusingopenposewithmultiplevideocameras AT iinoyoichi evaluationof3dmarkerlessmotioncaptureaccuracyusingopenposewithmultiplevideocameras AT fukashirosenshi evaluationof3dmarkerlessmotioncaptureaccuracyusingopenposewithmultiplevideocameras AT yoshiokashinsuke evaluationof3dmarkerlessmotioncaptureaccuracyusingopenposewithmultiplevideocameras |