Cargando…
TIF-Reg: Point Cloud Registration with Transform-Invariant Features in SE(3)
Three-dimensional point cloud registration (PCReg) has a wide range of applications in computer vision, 3D reconstruction and medical fields. Although numerous advances have been achieved in the field of point cloud registration in recent years, large-scale rigid transformation is a problem that mos...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8434253/ https://www.ncbi.nlm.nih.gov/pubmed/34502669 http://dx.doi.org/10.3390/s21175778 |
_version_ | 1783751554357002240 |
---|---|
author | Chen, Baifan Chen, Hong Song, Baojun Gong, Grace |
author_facet | Chen, Baifan Chen, Hong Song, Baojun Gong, Grace |
author_sort | Chen, Baifan |
collection | PubMed |
description | Three-dimensional point cloud registration (PCReg) has a wide range of applications in computer vision, 3D reconstruction and medical fields. Although numerous advances have been achieved in the field of point cloud registration in recent years, large-scale rigid transformation is a problem that most algorithms still cannot effectively handle. To solve this problem, we propose a point cloud registration method based on learning and transform-invariant features (TIF-Reg). Our algorithm includes four modules, which are the transform-invariant feature extraction module, deep feature embedding module, corresponding point generation module and decoupled singular value decomposition (SVD) module. In the transform-invariant feature extraction module, we design TIF in SE(3) (which means the 3D rigid transformation space) which contains a triangular feature and local density feature for points. It fully exploits the transformation invariance of point clouds, making the algorithm highly robust to rigid transformation. The deep feature embedding module embeds TIF into a high-dimension space using a deep neural network, further improving the expression ability of features. The corresponding point cloud is generated using an attention mechanism in the corresponding point generation module, and the final transformation for registration is calculated in the decoupled SVD module. In an experiment, we first train and evaluate the TIF-Reg method on the ModelNet40 dataset. The results show that our method keeps the root mean squared error (RMSE) of rotation within 0.5 [Formula: see text] and the RMSE of translation error close to 0 m, even when the rotation is up to [−180 [Formula: see text] , 180 [Formula: see text]] or the translation is up to [−20 m, 20 m]. We also test the generalization of our method on the TUM3D dataset using the model trained on Modelnet40. The results show that our method’s errors are close to the experimental results on Modelnet40, which verifies the good generalization ability of our method. All experiments prove that the proposed method is superior to state-of-the-art PCReg algorithms in terms of accuracy and complexity. |
format | Online Article Text |
id | pubmed-8434253 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-84342532021-09-12 TIF-Reg: Point Cloud Registration with Transform-Invariant Features in SE(3) Chen, Baifan Chen, Hong Song, Baojun Gong, Grace Sensors (Basel) Article Three-dimensional point cloud registration (PCReg) has a wide range of applications in computer vision, 3D reconstruction and medical fields. Although numerous advances have been achieved in the field of point cloud registration in recent years, large-scale rigid transformation is a problem that most algorithms still cannot effectively handle. To solve this problem, we propose a point cloud registration method based on learning and transform-invariant features (TIF-Reg). Our algorithm includes four modules, which are the transform-invariant feature extraction module, deep feature embedding module, corresponding point generation module and decoupled singular value decomposition (SVD) module. In the transform-invariant feature extraction module, we design TIF in SE(3) (which means the 3D rigid transformation space) which contains a triangular feature and local density feature for points. It fully exploits the transformation invariance of point clouds, making the algorithm highly robust to rigid transformation. The deep feature embedding module embeds TIF into a high-dimension space using a deep neural network, further improving the expression ability of features. The corresponding point cloud is generated using an attention mechanism in the corresponding point generation module, and the final transformation for registration is calculated in the decoupled SVD module. In an experiment, we first train and evaluate the TIF-Reg method on the ModelNet40 dataset. The results show that our method keeps the root mean squared error (RMSE) of rotation within 0.5 [Formula: see text] and the RMSE of translation error close to 0 m, even when the rotation is up to [−180 [Formula: see text] , 180 [Formula: see text]] or the translation is up to [−20 m, 20 m]. We also test the generalization of our method on the TUM3D dataset using the model trained on Modelnet40. The results show that our method’s errors are close to the experimental results on Modelnet40, which verifies the good generalization ability of our method. All experiments prove that the proposed method is superior to state-of-the-art PCReg algorithms in terms of accuracy and complexity. MDPI 2021-08-27 /pmc/articles/PMC8434253/ /pubmed/34502669 http://dx.doi.org/10.3390/s21175778 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Chen, Baifan Chen, Hong Song, Baojun Gong, Grace TIF-Reg: Point Cloud Registration with Transform-Invariant Features in SE(3) |
title | TIF-Reg: Point Cloud Registration with Transform-Invariant Features in SE(3) |
title_full | TIF-Reg: Point Cloud Registration with Transform-Invariant Features in SE(3) |
title_fullStr | TIF-Reg: Point Cloud Registration with Transform-Invariant Features in SE(3) |
title_full_unstemmed | TIF-Reg: Point Cloud Registration with Transform-Invariant Features in SE(3) |
title_short | TIF-Reg: Point Cloud Registration with Transform-Invariant Features in SE(3) |
title_sort | tif-reg: point cloud registration with transform-invariant features in se(3) |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8434253/ https://www.ncbi.nlm.nih.gov/pubmed/34502669 http://dx.doi.org/10.3390/s21175778 |
work_keys_str_mv | AT chenbaifan tifregpointcloudregistrationwithtransforminvariantfeaturesinse3 AT chenhong tifregpointcloudregistrationwithtransforminvariantfeaturesinse3 AT songbaojun tifregpointcloudregistrationwithtransforminvariantfeaturesinse3 AT gonggrace tifregpointcloudregistrationwithtransforminvariantfeaturesinse3 |