Cargando…

A New Volumetric Fusion Strategy with Adaptive Weight Field for RGB-D Reconstruction

High-quality 3D reconstruction results are very important in many application fields. However, current texture generation methods based on point sampling and fusion often produce blur. To solve this problem, we propose a new volumetric fusion strategy which can be embedded in the current online and...

Descripción completa

Detalles Bibliográficos
Autores principales: Liu, Xinqi, Li, Jituo, Lu, Guodong
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7436277/
https://www.ncbi.nlm.nih.gov/pubmed/32756524
http://dx.doi.org/10.3390/s20154330
_version_ 1783572509933699072
author Liu, Xinqi
Li, Jituo
Lu, Guodong
author_facet Liu, Xinqi
Li, Jituo
Lu, Guodong
author_sort Liu, Xinqi
collection PubMed
description High-quality 3D reconstruction results are very important in many application fields. However, current texture generation methods based on point sampling and fusion often produce blur. To solve this problem, we propose a new volumetric fusion strategy which can be embedded in the current online and offline reconstruction framework as a basic module to achieve excellent geometry and texture effects. The improvement comes from two aspects. Firstly, we establish an adaptive weight field to evaluate and adjust the reliability of data from RGB-D images by using a probabilistic and heuristic method. By using this adaptive weight field to guide the voxel fusion process, we can effectively preserve the local texture structure of the mesh, avoid wrong texture problems and suppress the influence of outlier noise on the geometric surface. Secondly, we use a new texture fusion strategy that combines replacement, integration, and fixedness operations to fuse and update voxel texture to reduce blur. Experimental results demonstrate that compared with the classical KinectFusion, our approach can significantly improve the accuracy in geometry and texture clarity, and can achieve equivalent texture reconstruction effects in real-time as the offline reconstruction methods such as intrinsic3d, even better in relief scenes.
format Online
Article
Text
id pubmed-7436277
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-74362772020-08-24 A New Volumetric Fusion Strategy with Adaptive Weight Field for RGB-D Reconstruction Liu, Xinqi Li, Jituo Lu, Guodong Sensors (Basel) Article High-quality 3D reconstruction results are very important in many application fields. However, current texture generation methods based on point sampling and fusion often produce blur. To solve this problem, we propose a new volumetric fusion strategy which can be embedded in the current online and offline reconstruction framework as a basic module to achieve excellent geometry and texture effects. The improvement comes from two aspects. Firstly, we establish an adaptive weight field to evaluate and adjust the reliability of data from RGB-D images by using a probabilistic and heuristic method. By using this adaptive weight field to guide the voxel fusion process, we can effectively preserve the local texture structure of the mesh, avoid wrong texture problems and suppress the influence of outlier noise on the geometric surface. Secondly, we use a new texture fusion strategy that combines replacement, integration, and fixedness operations to fuse and update voxel texture to reduce blur. Experimental results demonstrate that compared with the classical KinectFusion, our approach can significantly improve the accuracy in geometry and texture clarity, and can achieve equivalent texture reconstruction effects in real-time as the offline reconstruction methods such as intrinsic3d, even better in relief scenes. MDPI 2020-08-03 /pmc/articles/PMC7436277/ /pubmed/32756524 http://dx.doi.org/10.3390/s20154330 Text en © 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Liu, Xinqi
Li, Jituo
Lu, Guodong
A New Volumetric Fusion Strategy with Adaptive Weight Field for RGB-D Reconstruction
title A New Volumetric Fusion Strategy with Adaptive Weight Field for RGB-D Reconstruction
title_full A New Volumetric Fusion Strategy with Adaptive Weight Field for RGB-D Reconstruction
title_fullStr A New Volumetric Fusion Strategy with Adaptive Weight Field for RGB-D Reconstruction
title_full_unstemmed A New Volumetric Fusion Strategy with Adaptive Weight Field for RGB-D Reconstruction
title_short A New Volumetric Fusion Strategy with Adaptive Weight Field for RGB-D Reconstruction
title_sort new volumetric fusion strategy with adaptive weight field for rgb-d reconstruction
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7436277/
https://www.ncbi.nlm.nih.gov/pubmed/32756524
http://dx.doi.org/10.3390/s20154330
work_keys_str_mv AT liuxinqi anewvolumetricfusionstrategywithadaptiveweightfieldforrgbdreconstruction
AT lijituo anewvolumetricfusionstrategywithadaptiveweightfieldforrgbdreconstruction
AT luguodong anewvolumetricfusionstrategywithadaptiveweightfieldforrgbdreconstruction
AT liuxinqi newvolumetricfusionstrategywithadaptiveweightfieldforrgbdreconstruction
AT lijituo newvolumetricfusionstrategywithadaptiveweightfieldforrgbdreconstruction
AT luguodong newvolumetricfusionstrategywithadaptiveweightfieldforrgbdreconstruction