Cargando…

Contrastive Learning for 3D Point Clouds Classification and Shape Completion

In this paper, we present the idea of Self Supervised learning on the shape completion and classification of point clouds. Most 3D shape completion pipelines utilize AutoEncoders to extract features from point clouds used in downstream tasks such as classification, segmentation, detection, and other...

Descripción completa

Detalles Bibliográficos
Autores principales: Nazir, Danish, Afzal, Muhammad Zeshan, Pagani, Alain, Liwicki, Marcus, Stricker, Didier
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8587100/
https://www.ncbi.nlm.nih.gov/pubmed/34770698
http://dx.doi.org/10.3390/s21217392
_version_ 1784598033563910144
author Nazir, Danish
Afzal, Muhammad Zeshan
Pagani, Alain
Liwicki, Marcus
Stricker, Didier
author_facet Nazir, Danish
Afzal, Muhammad Zeshan
Pagani, Alain
Liwicki, Marcus
Stricker, Didier
author_sort Nazir, Danish
collection PubMed
description In this paper, we present the idea of Self Supervised learning on the shape completion and classification of point clouds. Most 3D shape completion pipelines utilize AutoEncoders to extract features from point clouds used in downstream tasks such as classification, segmentation, detection, and other related applications. Our idea is to add contrastive learning into AutoEncoders to encourage global feature learning of the point cloud classes. It is performed by optimizing triplet loss. Furthermore, local feature representations learning of point cloud is performed by adding the Chamfer distance function. To evaluate the performance of our approach, we utilize the PointNet classifier. We also extend the number of classes for evaluation from 4 to 10 to show the generalization ability of the learned features. Based on our results, embeddings generated from the contrastive AutoEncoder enhances shape completion and classification performance from [Formula: see text] to [Formula: see text] of point clouds achieving the state-of-the-art results with 10 classes.
format Online
Article
Text
id pubmed-8587100
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-85871002021-11-13 Contrastive Learning for 3D Point Clouds Classification and Shape Completion Nazir, Danish Afzal, Muhammad Zeshan Pagani, Alain Liwicki, Marcus Stricker, Didier Sensors (Basel) Article In this paper, we present the idea of Self Supervised learning on the shape completion and classification of point clouds. Most 3D shape completion pipelines utilize AutoEncoders to extract features from point clouds used in downstream tasks such as classification, segmentation, detection, and other related applications. Our idea is to add contrastive learning into AutoEncoders to encourage global feature learning of the point cloud classes. It is performed by optimizing triplet loss. Furthermore, local feature representations learning of point cloud is performed by adding the Chamfer distance function. To evaluate the performance of our approach, we utilize the PointNet classifier. We also extend the number of classes for evaluation from 4 to 10 to show the generalization ability of the learned features. Based on our results, embeddings generated from the contrastive AutoEncoder enhances shape completion and classification performance from [Formula: see text] to [Formula: see text] of point clouds achieving the state-of-the-art results with 10 classes. MDPI 2021-11-06 /pmc/articles/PMC8587100/ /pubmed/34770698 http://dx.doi.org/10.3390/s21217392 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Nazir, Danish
Afzal, Muhammad Zeshan
Pagani, Alain
Liwicki, Marcus
Stricker, Didier
Contrastive Learning for 3D Point Clouds Classification and Shape Completion
title Contrastive Learning for 3D Point Clouds Classification and Shape Completion
title_full Contrastive Learning for 3D Point Clouds Classification and Shape Completion
title_fullStr Contrastive Learning for 3D Point Clouds Classification and Shape Completion
title_full_unstemmed Contrastive Learning for 3D Point Clouds Classification and Shape Completion
title_short Contrastive Learning for 3D Point Clouds Classification and Shape Completion
title_sort contrastive learning for 3d point clouds classification and shape completion
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8587100/
https://www.ncbi.nlm.nih.gov/pubmed/34770698
http://dx.doi.org/10.3390/s21217392
work_keys_str_mv AT nazirdanish contrastivelearningfor3dpointcloudsclassificationandshapecompletion
AT afzalmuhammadzeshan contrastivelearningfor3dpointcloudsclassificationandshapecompletion
AT paganialain contrastivelearningfor3dpointcloudsclassificationandshapecompletion
AT liwickimarcus contrastivelearningfor3dpointcloudsclassificationandshapecompletion
AT strickerdidier contrastivelearningfor3dpointcloudsclassificationandshapecompletion