Cargando…
Point Cloud Scene Completion of Obstructed Building Facades with Generative Adversarial Inpainting
Collecting 3D point cloud data of buildings is important for many applications such as urban mapping, renovation, preservation, and energy simulation. However, laser-scanned point clouds are often difficult to analyze, visualize, and interpret due to incompletely scanned building facades caused by n...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2020
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7571037/ https://www.ncbi.nlm.nih.gov/pubmed/32899749 http://dx.doi.org/10.3390/s20185029 |
_version_ | 1783597084396486656 |
---|---|
author | Chen, Jingdao Yi, John Seon Keun Kahoush, Mark Cho, Erin S. Cho, Yong K. |
author_facet | Chen, Jingdao Yi, John Seon Keun Kahoush, Mark Cho, Erin S. Cho, Yong K. |
author_sort | Chen, Jingdao |
collection | PubMed |
description | Collecting 3D point cloud data of buildings is important for many applications such as urban mapping, renovation, preservation, and energy simulation. However, laser-scanned point clouds are often difficult to analyze, visualize, and interpret due to incompletely scanned building facades caused by numerous sources of defects such as noise, occlusions, and moving objects. Several point cloud scene completion algorithms have been proposed in the literature, but they have been mostly applied to individual objects or small-scale indoor environments and not on large-scale scans of building facades. This paper introduces a method of performing point cloud scene completion of building facades using orthographic projection and generative adversarial inpainting methods. The point cloud is first converted into the 2D structured representation of depth and color images using an orthographic projection approach. Then, a data-driven 2D inpainting approach is used to predict the complete version of the scene, given the incomplete scene in the image domain. The 2D inpainting process is fully automated and uses a customized generative-adversarial network based on Pix2Pix that is trainable end-to-end. The inpainted 2D image is finally converted back into a 3D point cloud using depth remapping. The proposed method is compared against several baseline methods, including geometric methods such as Poisson reconstruction and hole-filling, as well as learning-based methods such as the point completion network (PCN) and TopNet. Performance evaluation is carried out based on the task of reconstructing real-world building facades from partial laser-scanned point clouds. Experimental results using the performance metrics of voxel precision, voxel recall, position error, and color error showed that the proposed method has the best performance overall. |
format | Online Article Text |
id | pubmed-7571037 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2020 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-75710372020-10-28 Point Cloud Scene Completion of Obstructed Building Facades with Generative Adversarial Inpainting Chen, Jingdao Yi, John Seon Keun Kahoush, Mark Cho, Erin S. Cho, Yong K. Sensors (Basel) Article Collecting 3D point cloud data of buildings is important for many applications such as urban mapping, renovation, preservation, and energy simulation. However, laser-scanned point clouds are often difficult to analyze, visualize, and interpret due to incompletely scanned building facades caused by numerous sources of defects such as noise, occlusions, and moving objects. Several point cloud scene completion algorithms have been proposed in the literature, but they have been mostly applied to individual objects or small-scale indoor environments and not on large-scale scans of building facades. This paper introduces a method of performing point cloud scene completion of building facades using orthographic projection and generative adversarial inpainting methods. The point cloud is first converted into the 2D structured representation of depth and color images using an orthographic projection approach. Then, a data-driven 2D inpainting approach is used to predict the complete version of the scene, given the incomplete scene in the image domain. The 2D inpainting process is fully automated and uses a customized generative-adversarial network based on Pix2Pix that is trainable end-to-end. The inpainted 2D image is finally converted back into a 3D point cloud using depth remapping. The proposed method is compared against several baseline methods, including geometric methods such as Poisson reconstruction and hole-filling, as well as learning-based methods such as the point completion network (PCN) and TopNet. Performance evaluation is carried out based on the task of reconstructing real-world building facades from partial laser-scanned point clouds. Experimental results using the performance metrics of voxel precision, voxel recall, position error, and color error showed that the proposed method has the best performance overall. MDPI 2020-09-04 /pmc/articles/PMC7571037/ /pubmed/32899749 http://dx.doi.org/10.3390/s20185029 Text en © 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Chen, Jingdao Yi, John Seon Keun Kahoush, Mark Cho, Erin S. Cho, Yong K. Point Cloud Scene Completion of Obstructed Building Facades with Generative Adversarial Inpainting |
title | Point Cloud Scene Completion of Obstructed Building Facades with Generative Adversarial Inpainting |
title_full | Point Cloud Scene Completion of Obstructed Building Facades with Generative Adversarial Inpainting |
title_fullStr | Point Cloud Scene Completion of Obstructed Building Facades with Generative Adversarial Inpainting |
title_full_unstemmed | Point Cloud Scene Completion of Obstructed Building Facades with Generative Adversarial Inpainting |
title_short | Point Cloud Scene Completion of Obstructed Building Facades with Generative Adversarial Inpainting |
title_sort | point cloud scene completion of obstructed building facades with generative adversarial inpainting |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7571037/ https://www.ncbi.nlm.nih.gov/pubmed/32899749 http://dx.doi.org/10.3390/s20185029 |
work_keys_str_mv | AT chenjingdao pointcloudscenecompletionofobstructedbuildingfacadeswithgenerativeadversarialinpainting AT yijohnseonkeun pointcloudscenecompletionofobstructedbuildingfacadeswithgenerativeadversarialinpainting AT kahoushmark pointcloudscenecompletionofobstructedbuildingfacadeswithgenerativeadversarialinpainting AT choerins pointcloudscenecompletionofobstructedbuildingfacadeswithgenerativeadversarialinpainting AT choyongk pointcloudscenecompletionofobstructedbuildingfacadeswithgenerativeadversarialinpainting |