Cargando…

Fast and Automatic Reconstruction of Semantically Rich 3D Indoor Maps from Low-quality RGB-D Sequences

Semantically rich indoor models are increasingly used throughout a facility’s life cycle for different applications. With the decreasing price of 3D sensors, it is convenient to acquire point cloud data from consumer-level scanners. However, most existing methods in 3D indoor reconstruction from poi...

Descripción completa

Detalles Bibliográficos
Autores principales: Tang, Shengjun, Zhang, Yunjie, Li, You, Yuan, Zhilu, Wang, Yankun, Zhang, Xiang, Li, Xiaoming, Zhang, Yeting, Guo, Renzhong, Wang, Weixi
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2019
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6387083/
https://www.ncbi.nlm.nih.gov/pubmed/30691244
http://dx.doi.org/10.3390/s19030533
_version_ 1783397491654262784
author Tang, Shengjun
Zhang, Yunjie
Li, You
Yuan, Zhilu
Wang, Yankun
Zhang, Xiang
Li, Xiaoming
Zhang, Yeting
Guo, Renzhong
Wang, Weixi
author_facet Tang, Shengjun
Zhang, Yunjie
Li, You
Yuan, Zhilu
Wang, Yankun
Zhang, Xiang
Li, Xiaoming
Zhang, Yeting
Guo, Renzhong
Wang, Weixi
author_sort Tang, Shengjun
collection PubMed
description Semantically rich indoor models are increasingly used throughout a facility’s life cycle for different applications. With the decreasing price of 3D sensors, it is convenient to acquire point cloud data from consumer-level scanners. However, most existing methods in 3D indoor reconstruction from point clouds involve a tedious manual or interactive process due to line-of-sight occlusions and complex space structures. Using the multiple types of data obtained by RGB-D devices, this paper proposes a fast and automatic method for reconstructing semantically rich indoor 3D building models from low-quality RGB-D sequences. Our method is capable of identifying and modelling the main structural components of indoor environments such as space, wall, floor, ceilings, windows, and doors from the RGB-D datasets. The method includes space division and extraction, opening extraction, and global optimization. For space division and extraction, rather than distinguishing room spaces based on the detected wall planes, we interactively define the start-stop position for each functional space (e.g., room, corridor, kitchen) during scanning. Then, an interior elements filtering algorithm is proposed for wall component extraction and a boundary generation algorithm is used for space layout determination. For opening extraction, we propose a new noise robustness method based on the properties of convex hull, octrees structure, Euclidean clusters and the camera trajectory for opening generation, which is inapplicable to the data collected in the indoor environments due to inevitable occlusion. A global optimization approach for planes is designed to eliminate the inconsistency of planes sharing the same global plane, and maintain plausible connectivity between the walls and the relationships between the walls and openings. The final model is stored according to the CityGML3.0 standard. Our approach allows for the robust generation of semantically rich 3D indoor models and has strong applicability and reconstruction power for complex real-world datasets.
format Online
Article
Text
id pubmed-6387083
institution National Center for Biotechnology Information
language English
publishDate 2019
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-63870832019-02-26 Fast and Automatic Reconstruction of Semantically Rich 3D Indoor Maps from Low-quality RGB-D Sequences Tang, Shengjun Zhang, Yunjie Li, You Yuan, Zhilu Wang, Yankun Zhang, Xiang Li, Xiaoming Zhang, Yeting Guo, Renzhong Wang, Weixi Sensors (Basel) Article Semantically rich indoor models are increasingly used throughout a facility’s life cycle for different applications. With the decreasing price of 3D sensors, it is convenient to acquire point cloud data from consumer-level scanners. However, most existing methods in 3D indoor reconstruction from point clouds involve a tedious manual or interactive process due to line-of-sight occlusions and complex space structures. Using the multiple types of data obtained by RGB-D devices, this paper proposes a fast and automatic method for reconstructing semantically rich indoor 3D building models from low-quality RGB-D sequences. Our method is capable of identifying and modelling the main structural components of indoor environments such as space, wall, floor, ceilings, windows, and doors from the RGB-D datasets. The method includes space division and extraction, opening extraction, and global optimization. For space division and extraction, rather than distinguishing room spaces based on the detected wall planes, we interactively define the start-stop position for each functional space (e.g., room, corridor, kitchen) during scanning. Then, an interior elements filtering algorithm is proposed for wall component extraction and a boundary generation algorithm is used for space layout determination. For opening extraction, we propose a new noise robustness method based on the properties of convex hull, octrees structure, Euclidean clusters and the camera trajectory for opening generation, which is inapplicable to the data collected in the indoor environments due to inevitable occlusion. A global optimization approach for planes is designed to eliminate the inconsistency of planes sharing the same global plane, and maintain plausible connectivity between the walls and the relationships between the walls and openings. The final model is stored according to the CityGML3.0 standard. Our approach allows for the robust generation of semantically rich 3D indoor models and has strong applicability and reconstruction power for complex real-world datasets. MDPI 2019-01-27 /pmc/articles/PMC6387083/ /pubmed/30691244 http://dx.doi.org/10.3390/s19030533 Text en © 2019 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Tang, Shengjun
Zhang, Yunjie
Li, You
Yuan, Zhilu
Wang, Yankun
Zhang, Xiang
Li, Xiaoming
Zhang, Yeting
Guo, Renzhong
Wang, Weixi
Fast and Automatic Reconstruction of Semantically Rich 3D Indoor Maps from Low-quality RGB-D Sequences
title Fast and Automatic Reconstruction of Semantically Rich 3D Indoor Maps from Low-quality RGB-D Sequences
title_full Fast and Automatic Reconstruction of Semantically Rich 3D Indoor Maps from Low-quality RGB-D Sequences
title_fullStr Fast and Automatic Reconstruction of Semantically Rich 3D Indoor Maps from Low-quality RGB-D Sequences
title_full_unstemmed Fast and Automatic Reconstruction of Semantically Rich 3D Indoor Maps from Low-quality RGB-D Sequences
title_short Fast and Automatic Reconstruction of Semantically Rich 3D Indoor Maps from Low-quality RGB-D Sequences
title_sort fast and automatic reconstruction of semantically rich 3d indoor maps from low-quality rgb-d sequences
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6387083/
https://www.ncbi.nlm.nih.gov/pubmed/30691244
http://dx.doi.org/10.3390/s19030533
work_keys_str_mv AT tangshengjun fastandautomaticreconstructionofsemanticallyrich3dindoormapsfromlowqualityrgbdsequences
AT zhangyunjie fastandautomaticreconstructionofsemanticallyrich3dindoormapsfromlowqualityrgbdsequences
AT liyou fastandautomaticreconstructionofsemanticallyrich3dindoormapsfromlowqualityrgbdsequences
AT yuanzhilu fastandautomaticreconstructionofsemanticallyrich3dindoormapsfromlowqualityrgbdsequences
AT wangyankun fastandautomaticreconstructionofsemanticallyrich3dindoormapsfromlowqualityrgbdsequences
AT zhangxiang fastandautomaticreconstructionofsemanticallyrich3dindoormapsfromlowqualityrgbdsequences
AT lixiaoming fastandautomaticreconstructionofsemanticallyrich3dindoormapsfromlowqualityrgbdsequences
AT zhangyeting fastandautomaticreconstructionofsemanticallyrich3dindoormapsfromlowqualityrgbdsequences
AT guorenzhong fastandautomaticreconstructionofsemanticallyrich3dindoormapsfromlowqualityrgbdsequences
AT wangweixi fastandautomaticreconstructionofsemanticallyrich3dindoormapsfromlowqualityrgbdsequences