Cargando…

Evaluation of 3D Markerless Motion Capture Accuracy Using OpenPose With Multiple Video Cameras

There is a need within human movement sciences for a markerless motion capture system, which is easy to use and sufficiently accurate to evaluate motor performance. This study aims to develop a 3D markerless motion capture technique, using OpenPose with multiple synchronized video cameras, and exami...

Descripción completa

Detalles Bibliográficos
Autores principales: Nakano, Nobuyasu, Sakura, Tetsuro, Ueda, Kazuhiro, Omura, Leon, Kimura, Arata, Iino, Yoichi, Fukashiro, Senshi, Yoshioka, Shinsuke
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7739760/
https://www.ncbi.nlm.nih.gov/pubmed/33345042
http://dx.doi.org/10.3389/fspor.2020.00050
_version_ 1783623392961757184
author Nakano, Nobuyasu
Sakura, Tetsuro
Ueda, Kazuhiro
Omura, Leon
Kimura, Arata
Iino, Yoichi
Fukashiro, Senshi
Yoshioka, Shinsuke
author_facet Nakano, Nobuyasu
Sakura, Tetsuro
Ueda, Kazuhiro
Omura, Leon
Kimura, Arata
Iino, Yoichi
Fukashiro, Senshi
Yoshioka, Shinsuke
author_sort Nakano, Nobuyasu
collection PubMed
description There is a need within human movement sciences for a markerless motion capture system, which is easy to use and sufficiently accurate to evaluate motor performance. This study aims to develop a 3D markerless motion capture technique, using OpenPose with multiple synchronized video cameras, and examine its accuracy in comparison with optical marker-based motion capture. Participants performed three motor tasks (walking, countermovement jumping, and ball throwing), and these movements measured using both marker-based optical motion capture and OpenPose-based markerless motion capture. The differences in corresponding joint positions, estimated from the two different methods throughout the analysis, were presented as a mean absolute error (MAE). The results demonstrated that, qualitatively, 3D pose estimation using markerless motion capture could correctly reproduce the movements of participants. Quantitatively, of all the mean absolute errors calculated, approximately 47% were <20 mm, and 80% were <30 mm. However, 10% were >40 mm. The primary reason for mean absolute errors exceeding 40 mm was that OpenPose failed to track the participant's pose in 2D images owing to failures, such as recognition of an object as a human body segment or replacing one segment with another depending on the image of each frame. In conclusion, this study demonstrates that, if an algorithm that corrects all apparently wrong tracking can be incorporated into the system, OpenPose-based markerless motion capture can be used for human movement science with an accuracy of 30 mm or less.
format Online
Article
Text
id pubmed-7739760
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-77397602020-12-17 Evaluation of 3D Markerless Motion Capture Accuracy Using OpenPose With Multiple Video Cameras Nakano, Nobuyasu Sakura, Tetsuro Ueda, Kazuhiro Omura, Leon Kimura, Arata Iino, Yoichi Fukashiro, Senshi Yoshioka, Shinsuke Front Sports Act Living Sports and Active Living There is a need within human movement sciences for a markerless motion capture system, which is easy to use and sufficiently accurate to evaluate motor performance. This study aims to develop a 3D markerless motion capture technique, using OpenPose with multiple synchronized video cameras, and examine its accuracy in comparison with optical marker-based motion capture. Participants performed three motor tasks (walking, countermovement jumping, and ball throwing), and these movements measured using both marker-based optical motion capture and OpenPose-based markerless motion capture. The differences in corresponding joint positions, estimated from the two different methods throughout the analysis, were presented as a mean absolute error (MAE). The results demonstrated that, qualitatively, 3D pose estimation using markerless motion capture could correctly reproduce the movements of participants. Quantitatively, of all the mean absolute errors calculated, approximately 47% were <20 mm, and 80% were <30 mm. However, 10% were >40 mm. The primary reason for mean absolute errors exceeding 40 mm was that OpenPose failed to track the participant's pose in 2D images owing to failures, such as recognition of an object as a human body segment or replacing one segment with another depending on the image of each frame. In conclusion, this study demonstrates that, if an algorithm that corrects all apparently wrong tracking can be incorporated into the system, OpenPose-based markerless motion capture can be used for human movement science with an accuracy of 30 mm or less. Frontiers Media S.A. 2020-05-27 /pmc/articles/PMC7739760/ /pubmed/33345042 http://dx.doi.org/10.3389/fspor.2020.00050 Text en Copyright © 2020 Nakano, Sakura, Ueda, Omura, Kimura, Iino, Fukashiro and Yoshioka. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Sports and Active Living
Nakano, Nobuyasu
Sakura, Tetsuro
Ueda, Kazuhiro
Omura, Leon
Kimura, Arata
Iino, Yoichi
Fukashiro, Senshi
Yoshioka, Shinsuke
Evaluation of 3D Markerless Motion Capture Accuracy Using OpenPose With Multiple Video Cameras
title Evaluation of 3D Markerless Motion Capture Accuracy Using OpenPose With Multiple Video Cameras
title_full Evaluation of 3D Markerless Motion Capture Accuracy Using OpenPose With Multiple Video Cameras
title_fullStr Evaluation of 3D Markerless Motion Capture Accuracy Using OpenPose With Multiple Video Cameras
title_full_unstemmed Evaluation of 3D Markerless Motion Capture Accuracy Using OpenPose With Multiple Video Cameras
title_short Evaluation of 3D Markerless Motion Capture Accuracy Using OpenPose With Multiple Video Cameras
title_sort evaluation of 3d markerless motion capture accuracy using openpose with multiple video cameras
topic Sports and Active Living
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7739760/
https://www.ncbi.nlm.nih.gov/pubmed/33345042
http://dx.doi.org/10.3389/fspor.2020.00050
work_keys_str_mv AT nakanonobuyasu evaluationof3dmarkerlessmotioncaptureaccuracyusingopenposewithmultiplevideocameras
AT sakuratetsuro evaluationof3dmarkerlessmotioncaptureaccuracyusingopenposewithmultiplevideocameras
AT uedakazuhiro evaluationof3dmarkerlessmotioncaptureaccuracyusingopenposewithmultiplevideocameras
AT omuraleon evaluationof3dmarkerlessmotioncaptureaccuracyusingopenposewithmultiplevideocameras
AT kimuraarata evaluationof3dmarkerlessmotioncaptureaccuracyusingopenposewithmultiplevideocameras
AT iinoyoichi evaluationof3dmarkerlessmotioncaptureaccuracyusingopenposewithmultiplevideocameras
AT fukashirosenshi evaluationof3dmarkerlessmotioncaptureaccuracyusingopenposewithmultiplevideocameras
AT yoshiokashinsuke evaluationof3dmarkerlessmotioncaptureaccuracyusingopenposewithmultiplevideocameras