Cargando…

Human Motion Tracking with Less Constraint of Initial Posture from a Single RGB-D Sensor

High-quality and complete human motion 4D reconstruction is of great significance for immersive VR and even human operation. However, it has inevitable self-scanning constraints, and tracking under monocular settings also has strict restrictions. In this paper, we propose a human motion capture syst...

Descripción completa

Detalles Bibliográficos
Autores principales: Liu, Chen, Wang, Anna, Bu, Chunguang, Wang, Wenhui, Sun, Haijing
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8123514/
https://www.ncbi.nlm.nih.gov/pubmed/33925847
http://dx.doi.org/10.3390/s21093029
_version_ 1783692928902758400
author Liu, Chen
Wang, Anna
Bu, Chunguang
Wang, Wenhui
Sun, Haijing
author_facet Liu, Chen
Wang, Anna
Bu, Chunguang
Wang, Wenhui
Sun, Haijing
author_sort Liu, Chen
collection PubMed
description High-quality and complete human motion 4D reconstruction is of great significance for immersive VR and even human operation. However, it has inevitable self-scanning constraints, and tracking under monocular settings also has strict restrictions. In this paper, we propose a human motion capture system combined with human priors and performance capture that only uses a single RGB-D sensor. To break the self-scanning constraint, we generated a complete mesh only using the front view input to initialize the geometric capture. In order to construct a correct warping field, most previous methods initialize their systems in a strict way. To maintain high fidelity while increasing the easiness of the system, we updated the model while capturing motion. Additionally, we blended in human priors in order to improve the reliability of model warping. Extensive experiments demonstrated that our method can be used more comfortably while maintaining credible geometric warping and remaining free of self-scanning constraints.
format Online
Article
Text
id pubmed-8123514
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-81235142021-05-16 Human Motion Tracking with Less Constraint of Initial Posture from a Single RGB-D Sensor Liu, Chen Wang, Anna Bu, Chunguang Wang, Wenhui Sun, Haijing Sensors (Basel) Article High-quality and complete human motion 4D reconstruction is of great significance for immersive VR and even human operation. However, it has inevitable self-scanning constraints, and tracking under monocular settings also has strict restrictions. In this paper, we propose a human motion capture system combined with human priors and performance capture that only uses a single RGB-D sensor. To break the self-scanning constraint, we generated a complete mesh only using the front view input to initialize the geometric capture. In order to construct a correct warping field, most previous methods initialize their systems in a strict way. To maintain high fidelity while increasing the easiness of the system, we updated the model while capturing motion. Additionally, we blended in human priors in order to improve the reliability of model warping. Extensive experiments demonstrated that our method can be used more comfortably while maintaining credible geometric warping and remaining free of self-scanning constraints. MDPI 2021-04-26 /pmc/articles/PMC8123514/ /pubmed/33925847 http://dx.doi.org/10.3390/s21093029 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Liu, Chen
Wang, Anna
Bu, Chunguang
Wang, Wenhui
Sun, Haijing
Human Motion Tracking with Less Constraint of Initial Posture from a Single RGB-D Sensor
title Human Motion Tracking with Less Constraint of Initial Posture from a Single RGB-D Sensor
title_full Human Motion Tracking with Less Constraint of Initial Posture from a Single RGB-D Sensor
title_fullStr Human Motion Tracking with Less Constraint of Initial Posture from a Single RGB-D Sensor
title_full_unstemmed Human Motion Tracking with Less Constraint of Initial Posture from a Single RGB-D Sensor
title_short Human Motion Tracking with Less Constraint of Initial Posture from a Single RGB-D Sensor
title_sort human motion tracking with less constraint of initial posture from a single rgb-d sensor
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8123514/
https://www.ncbi.nlm.nih.gov/pubmed/33925847
http://dx.doi.org/10.3390/s21093029
work_keys_str_mv AT liuchen humanmotiontrackingwithlessconstraintofinitialposturefromasinglergbdsensor
AT wanganna humanmotiontrackingwithlessconstraintofinitialposturefromasinglergbdsensor
AT buchunguang humanmotiontrackingwithlessconstraintofinitialposturefromasinglergbdsensor
AT wangwenhui humanmotiontrackingwithlessconstraintofinitialposturefromasinglergbdsensor
AT sunhaijing humanmotiontrackingwithlessconstraintofinitialposturefromasinglergbdsensor