Cargando…

Point Cloud Instance Segmentation with Inaccurate Bounding-Box Annotations

Most existing point cloud instance segmentation methods require accurate and dense point-level annotations, which are extremely laborious to collect. While incomplete and inexact supervision has been exploited to reduce labeling efforts, inaccurate supervision remains under-explored. This kind of su...

Descripción completa

Detalles Bibliográficos
Autores principales: Peng, Yinyin, Feng, Hui, Chen, Tao, Hu, Bo
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9960887/
https://www.ncbi.nlm.nih.gov/pubmed/36850943
http://dx.doi.org/10.3390/s23042343
_version_ 1784895619937075200
author Peng, Yinyin
Feng, Hui
Chen, Tao
Hu, Bo
author_facet Peng, Yinyin
Feng, Hui
Chen, Tao
Hu, Bo
author_sort Peng, Yinyin
collection PubMed
description Most existing point cloud instance segmentation methods require accurate and dense point-level annotations, which are extremely laborious to collect. While incomplete and inexact supervision has been exploited to reduce labeling efforts, inaccurate supervision remains under-explored. This kind of supervision is almost inevitable in practice, especially in complex 3D point clouds, and it severely degrades the generalization performance of deep networks. To this end, we propose the first weakly supervised point cloud instance segmentation framework with inaccurate box-level labels. A novel self-distillation architecture is presented to boost the generalization ability while leveraging the cheap but noisy bounding-box annotations. Specifically, we employ consistency regularization to distill self-knowledge from data perturbation and historical predictions, which prevents the deep network from overfitting the noisy labels. Moreover, we progressively select reliable samples and correct their labels based on the historical consistency. Extensive experiments on the ScanNet-v2 dataset were used to validate the effectiveness and robustness of our method in dealing with inexact and inaccurate annotations.
format Online
Article
Text
id pubmed-9960887
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-99608872023-02-26 Point Cloud Instance Segmentation with Inaccurate Bounding-Box Annotations Peng, Yinyin Feng, Hui Chen, Tao Hu, Bo Sensors (Basel) Article Most existing point cloud instance segmentation methods require accurate and dense point-level annotations, which are extremely laborious to collect. While incomplete and inexact supervision has been exploited to reduce labeling efforts, inaccurate supervision remains under-explored. This kind of supervision is almost inevitable in practice, especially in complex 3D point clouds, and it severely degrades the generalization performance of deep networks. To this end, we propose the first weakly supervised point cloud instance segmentation framework with inaccurate box-level labels. A novel self-distillation architecture is presented to boost the generalization ability while leveraging the cheap but noisy bounding-box annotations. Specifically, we employ consistency regularization to distill self-knowledge from data perturbation and historical predictions, which prevents the deep network from overfitting the noisy labels. Moreover, we progressively select reliable samples and correct their labels based on the historical consistency. Extensive experiments on the ScanNet-v2 dataset were used to validate the effectiveness and robustness of our method in dealing with inexact and inaccurate annotations. MDPI 2023-02-20 /pmc/articles/PMC9960887/ /pubmed/36850943 http://dx.doi.org/10.3390/s23042343 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Peng, Yinyin
Feng, Hui
Chen, Tao
Hu, Bo
Point Cloud Instance Segmentation with Inaccurate Bounding-Box Annotations
title Point Cloud Instance Segmentation with Inaccurate Bounding-Box Annotations
title_full Point Cloud Instance Segmentation with Inaccurate Bounding-Box Annotations
title_fullStr Point Cloud Instance Segmentation with Inaccurate Bounding-Box Annotations
title_full_unstemmed Point Cloud Instance Segmentation with Inaccurate Bounding-Box Annotations
title_short Point Cloud Instance Segmentation with Inaccurate Bounding-Box Annotations
title_sort point cloud instance segmentation with inaccurate bounding-box annotations
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9960887/
https://www.ncbi.nlm.nih.gov/pubmed/36850943
http://dx.doi.org/10.3390/s23042343
work_keys_str_mv AT pengyinyin pointcloudinstancesegmentationwithinaccurateboundingboxannotations
AT fenghui pointcloudinstancesegmentationwithinaccurateboundingboxannotations
AT chentao pointcloudinstancesegmentationwithinaccurateboundingboxannotations
AT hubo pointcloudinstancesegmentationwithinaccurateboundingboxannotations