Cargando…

TIF-Reg: Point Cloud Registration with Transform-Invariant Features in SE(3)

Three-dimensional point cloud registration (PCReg) has a wide range of applications in computer vision, 3D reconstruction and medical fields. Although numerous advances have been achieved in the field of point cloud registration in recent years, large-scale rigid transformation is a problem that mos...

Descripción completa

Detalles Bibliográficos
Autores principales: Chen, Baifan, Chen, Hong, Song, Baojun, Gong, Grace
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8434253/
https://www.ncbi.nlm.nih.gov/pubmed/34502669
http://dx.doi.org/10.3390/s21175778
_version_ 1783751554357002240
author Chen, Baifan
Chen, Hong
Song, Baojun
Gong, Grace
author_facet Chen, Baifan
Chen, Hong
Song, Baojun
Gong, Grace
author_sort Chen, Baifan
collection PubMed
description Three-dimensional point cloud registration (PCReg) has a wide range of applications in computer vision, 3D reconstruction and medical fields. Although numerous advances have been achieved in the field of point cloud registration in recent years, large-scale rigid transformation is a problem that most algorithms still cannot effectively handle. To solve this problem, we propose a point cloud registration method based on learning and transform-invariant features (TIF-Reg). Our algorithm includes four modules, which are the transform-invariant feature extraction module, deep feature embedding module, corresponding point generation module and decoupled singular value decomposition (SVD) module. In the transform-invariant feature extraction module, we design TIF in SE(3) (which means the 3D rigid transformation space) which contains a triangular feature and local density feature for points. It fully exploits the transformation invariance of point clouds, making the algorithm highly robust to rigid transformation. The deep feature embedding module embeds TIF into a high-dimension space using a deep neural network, further improving the expression ability of features. The corresponding point cloud is generated using an attention mechanism in the corresponding point generation module, and the final transformation for registration is calculated in the decoupled SVD module. In an experiment, we first train and evaluate the TIF-Reg method on the ModelNet40 dataset. The results show that our method keeps the root mean squared error (RMSE) of rotation within 0.5 [Formula: see text] and the RMSE of translation error close to 0 m, even when the rotation is up to [−180 [Formula: see text] , 180 [Formula: see text]] or the translation is up to [−20 m, 20 m]. We also test the generalization of our method on the TUM3D dataset using the model trained on Modelnet40. The results show that our method’s errors are close to the experimental results on Modelnet40, which verifies the good generalization ability of our method. All experiments prove that the proposed method is superior to state-of-the-art PCReg algorithms in terms of accuracy and complexity.
format Online
Article
Text
id pubmed-8434253
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-84342532021-09-12 TIF-Reg: Point Cloud Registration with Transform-Invariant Features in SE(3) Chen, Baifan Chen, Hong Song, Baojun Gong, Grace Sensors (Basel) Article Three-dimensional point cloud registration (PCReg) has a wide range of applications in computer vision, 3D reconstruction and medical fields. Although numerous advances have been achieved in the field of point cloud registration in recent years, large-scale rigid transformation is a problem that most algorithms still cannot effectively handle. To solve this problem, we propose a point cloud registration method based on learning and transform-invariant features (TIF-Reg). Our algorithm includes four modules, which are the transform-invariant feature extraction module, deep feature embedding module, corresponding point generation module and decoupled singular value decomposition (SVD) module. In the transform-invariant feature extraction module, we design TIF in SE(3) (which means the 3D rigid transformation space) which contains a triangular feature and local density feature for points. It fully exploits the transformation invariance of point clouds, making the algorithm highly robust to rigid transformation. The deep feature embedding module embeds TIF into a high-dimension space using a deep neural network, further improving the expression ability of features. The corresponding point cloud is generated using an attention mechanism in the corresponding point generation module, and the final transformation for registration is calculated in the decoupled SVD module. In an experiment, we first train and evaluate the TIF-Reg method on the ModelNet40 dataset. The results show that our method keeps the root mean squared error (RMSE) of rotation within 0.5 [Formula: see text] and the RMSE of translation error close to 0 m, even when the rotation is up to [−180 [Formula: see text] , 180 [Formula: see text]] or the translation is up to [−20 m, 20 m]. We also test the generalization of our method on the TUM3D dataset using the model trained on Modelnet40. The results show that our method’s errors are close to the experimental results on Modelnet40, which verifies the good generalization ability of our method. All experiments prove that the proposed method is superior to state-of-the-art PCReg algorithms in terms of accuracy and complexity. MDPI 2021-08-27 /pmc/articles/PMC8434253/ /pubmed/34502669 http://dx.doi.org/10.3390/s21175778 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Chen, Baifan
Chen, Hong
Song, Baojun
Gong, Grace
TIF-Reg: Point Cloud Registration with Transform-Invariant Features in SE(3)
title TIF-Reg: Point Cloud Registration with Transform-Invariant Features in SE(3)
title_full TIF-Reg: Point Cloud Registration with Transform-Invariant Features in SE(3)
title_fullStr TIF-Reg: Point Cloud Registration with Transform-Invariant Features in SE(3)
title_full_unstemmed TIF-Reg: Point Cloud Registration with Transform-Invariant Features in SE(3)
title_short TIF-Reg: Point Cloud Registration with Transform-Invariant Features in SE(3)
title_sort tif-reg: point cloud registration with transform-invariant features in se(3)
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8434253/
https://www.ncbi.nlm.nih.gov/pubmed/34502669
http://dx.doi.org/10.3390/s21175778
work_keys_str_mv AT chenbaifan tifregpointcloudregistrationwithtransforminvariantfeaturesinse3
AT chenhong tifregpointcloudregistrationwithtransforminvariantfeaturesinse3
AT songbaojun tifregpointcloudregistrationwithtransforminvariantfeaturesinse3
AT gonggrace tifregpointcloudregistrationwithtransforminvariantfeaturesinse3