Cargando…

A Deep Learning Method for 3D Object Classification and Retrieval Using the Global Point Signature Plus and Deep Wide Residual Network

A vital and challenging task in computer vision is 3D Object Classification and Retrieval, with many practical applications such as an intelligent robot, autonomous driving, multimedia contents processing and retrieval, and augmented/mixed reality. Various deep learning methods were introduced for s...

Descripción completa

Detalles Bibliográficos
Autores principales: Hoang, Long, Lee, Suk-Hwan, Kwon, Ki-Ryong
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8070544/
https://www.ncbi.nlm.nih.gov/pubmed/33918845
http://dx.doi.org/10.3390/s21082644
_version_ 1783683494915866624
author Hoang, Long
Lee, Suk-Hwan
Kwon, Ki-Ryong
author_facet Hoang, Long
Lee, Suk-Hwan
Kwon, Ki-Ryong
author_sort Hoang, Long
collection PubMed
description A vital and challenging task in computer vision is 3D Object Classification and Retrieval, with many practical applications such as an intelligent robot, autonomous driving, multimedia contents processing and retrieval, and augmented/mixed reality. Various deep learning methods were introduced for solving classification and retrieval problems of 3D objects. Almost all view-based methods use many views to handle spatial loss, although they perform the best among current techniques such as View-based, Voxelization, and Point Cloud methods. Many views make network structure more complicated due to the parallel Convolutional Neural Network (CNN). We propose a novel method that combines a Global Point Signature Plus with a Deep Wide Residual Network, namely GPSP-DWRN, in this paper. Global Point Signature Plus (GPSPlus) is a novel descriptor because it can capture more shape information of the 3D object for a single view. First, an original 3D model was converted into a colored one by applying GPSPlus. Then, a 32 × 32 × 3 matrix stored the obtained 2D projection of this color 3D model. This matrix was the input data of a Deep Residual Network, which used a single CNN structure. We evaluated the GPSP-DWRN for a retrieval task using the Shapnetcore55 dataset, while using two well-known datasets—ModelNet10 and ModelNet40 for a classification task. Based on our experimental results, our framework performed better than the state-of-the-art methods.
format Online
Article
Text
id pubmed-8070544
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-80705442021-04-26 A Deep Learning Method for 3D Object Classification and Retrieval Using the Global Point Signature Plus and Deep Wide Residual Network Hoang, Long Lee, Suk-Hwan Kwon, Ki-Ryong Sensors (Basel) Article A vital and challenging task in computer vision is 3D Object Classification and Retrieval, with many practical applications such as an intelligent robot, autonomous driving, multimedia contents processing and retrieval, and augmented/mixed reality. Various deep learning methods were introduced for solving classification and retrieval problems of 3D objects. Almost all view-based methods use many views to handle spatial loss, although they perform the best among current techniques such as View-based, Voxelization, and Point Cloud methods. Many views make network structure more complicated due to the parallel Convolutional Neural Network (CNN). We propose a novel method that combines a Global Point Signature Plus with a Deep Wide Residual Network, namely GPSP-DWRN, in this paper. Global Point Signature Plus (GPSPlus) is a novel descriptor because it can capture more shape information of the 3D object for a single view. First, an original 3D model was converted into a colored one by applying GPSPlus. Then, a 32 × 32 × 3 matrix stored the obtained 2D projection of this color 3D model. This matrix was the input data of a Deep Residual Network, which used a single CNN structure. We evaluated the GPSP-DWRN for a retrieval task using the Shapnetcore55 dataset, while using two well-known datasets—ModelNet10 and ModelNet40 for a classification task. Based on our experimental results, our framework performed better than the state-of-the-art methods. MDPI 2021-04-09 /pmc/articles/PMC8070544/ /pubmed/33918845 http://dx.doi.org/10.3390/s21082644 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Hoang, Long
Lee, Suk-Hwan
Kwon, Ki-Ryong
A Deep Learning Method for 3D Object Classification and Retrieval Using the Global Point Signature Plus and Deep Wide Residual Network
title A Deep Learning Method for 3D Object Classification and Retrieval Using the Global Point Signature Plus and Deep Wide Residual Network
title_full A Deep Learning Method for 3D Object Classification and Retrieval Using the Global Point Signature Plus and Deep Wide Residual Network
title_fullStr A Deep Learning Method for 3D Object Classification and Retrieval Using the Global Point Signature Plus and Deep Wide Residual Network
title_full_unstemmed A Deep Learning Method for 3D Object Classification and Retrieval Using the Global Point Signature Plus and Deep Wide Residual Network
title_short A Deep Learning Method for 3D Object Classification and Retrieval Using the Global Point Signature Plus and Deep Wide Residual Network
title_sort deep learning method for 3d object classification and retrieval using the global point signature plus and deep wide residual network
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8070544/
https://www.ncbi.nlm.nih.gov/pubmed/33918845
http://dx.doi.org/10.3390/s21082644
work_keys_str_mv AT hoanglong adeeplearningmethodfor3dobjectclassificationandretrievalusingtheglobalpointsignatureplusanddeepwideresidualnetwork
AT leesukhwan adeeplearningmethodfor3dobjectclassificationandretrievalusingtheglobalpointsignatureplusanddeepwideresidualnetwork
AT kwonkiryong adeeplearningmethodfor3dobjectclassificationandretrievalusingtheglobalpointsignatureplusanddeepwideresidualnetwork
AT hoanglong deeplearningmethodfor3dobjectclassificationandretrievalusingtheglobalpointsignatureplusanddeepwideresidualnetwork
AT leesukhwan deeplearningmethodfor3dobjectclassificationandretrievalusingtheglobalpointsignatureplusanddeepwideresidualnetwork
AT kwonkiryong deeplearningmethodfor3dobjectclassificationandretrievalusingtheglobalpointsignatureplusanddeepwideresidualnetwork