Cargando…
Human Motion Tracking with Less Constraint of Initial Posture from a Single RGB-D Sensor
High-quality and complete human motion 4D reconstruction is of great significance for immersive VR and even human operation. However, it has inevitable self-scanning constraints, and tracking under monocular settings also has strict restrictions. In this paper, we propose a human motion capture syst...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8123514/ https://www.ncbi.nlm.nih.gov/pubmed/33925847 http://dx.doi.org/10.3390/s21093029 |
_version_ | 1783692928902758400 |
---|---|
author | Liu, Chen Wang, Anna Bu, Chunguang Wang, Wenhui Sun, Haijing |
author_facet | Liu, Chen Wang, Anna Bu, Chunguang Wang, Wenhui Sun, Haijing |
author_sort | Liu, Chen |
collection | PubMed |
description | High-quality and complete human motion 4D reconstruction is of great significance for immersive VR and even human operation. However, it has inevitable self-scanning constraints, and tracking under monocular settings also has strict restrictions. In this paper, we propose a human motion capture system combined with human priors and performance capture that only uses a single RGB-D sensor. To break the self-scanning constraint, we generated a complete mesh only using the front view input to initialize the geometric capture. In order to construct a correct warping field, most previous methods initialize their systems in a strict way. To maintain high fidelity while increasing the easiness of the system, we updated the model while capturing motion. Additionally, we blended in human priors in order to improve the reliability of model warping. Extensive experiments demonstrated that our method can be used more comfortably while maintaining credible geometric warping and remaining free of self-scanning constraints. |
format | Online Article Text |
id | pubmed-8123514 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-81235142021-05-16 Human Motion Tracking with Less Constraint of Initial Posture from a Single RGB-D Sensor Liu, Chen Wang, Anna Bu, Chunguang Wang, Wenhui Sun, Haijing Sensors (Basel) Article High-quality and complete human motion 4D reconstruction is of great significance for immersive VR and even human operation. However, it has inevitable self-scanning constraints, and tracking under monocular settings also has strict restrictions. In this paper, we propose a human motion capture system combined with human priors and performance capture that only uses a single RGB-D sensor. To break the self-scanning constraint, we generated a complete mesh only using the front view input to initialize the geometric capture. In order to construct a correct warping field, most previous methods initialize their systems in a strict way. To maintain high fidelity while increasing the easiness of the system, we updated the model while capturing motion. Additionally, we blended in human priors in order to improve the reliability of model warping. Extensive experiments demonstrated that our method can be used more comfortably while maintaining credible geometric warping and remaining free of self-scanning constraints. MDPI 2021-04-26 /pmc/articles/PMC8123514/ /pubmed/33925847 http://dx.doi.org/10.3390/s21093029 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Liu, Chen Wang, Anna Bu, Chunguang Wang, Wenhui Sun, Haijing Human Motion Tracking with Less Constraint of Initial Posture from a Single RGB-D Sensor |
title | Human Motion Tracking with Less Constraint of Initial Posture from a Single RGB-D Sensor |
title_full | Human Motion Tracking with Less Constraint of Initial Posture from a Single RGB-D Sensor |
title_fullStr | Human Motion Tracking with Less Constraint of Initial Posture from a Single RGB-D Sensor |
title_full_unstemmed | Human Motion Tracking with Less Constraint of Initial Posture from a Single RGB-D Sensor |
title_short | Human Motion Tracking with Less Constraint of Initial Posture from a Single RGB-D Sensor |
title_sort | human motion tracking with less constraint of initial posture from a single rgb-d sensor |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8123514/ https://www.ncbi.nlm.nih.gov/pubmed/33925847 http://dx.doi.org/10.3390/s21093029 |
work_keys_str_mv | AT liuchen humanmotiontrackingwithlessconstraintofinitialposturefromasinglergbdsensor AT wanganna humanmotiontrackingwithlessconstraintofinitialposturefromasinglergbdsensor AT buchunguang humanmotiontrackingwithlessconstraintofinitialposturefromasinglergbdsensor AT wangwenhui humanmotiontrackingwithlessconstraintofinitialposturefromasinglergbdsensor AT sunhaijing humanmotiontrackingwithlessconstraintofinitialposturefromasinglergbdsensor |