Cargando…
Point Cloud Instance Segmentation with Inaccurate Bounding-Box Annotations
Most existing point cloud instance segmentation methods require accurate and dense point-level annotations, which are extremely laborious to collect. While incomplete and inexact supervision has been exploited to reduce labeling efforts, inaccurate supervision remains under-explored. This kind of su...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9960887/ https://www.ncbi.nlm.nih.gov/pubmed/36850943 http://dx.doi.org/10.3390/s23042343 |
_version_ | 1784895619937075200 |
---|---|
author | Peng, Yinyin Feng, Hui Chen, Tao Hu, Bo |
author_facet | Peng, Yinyin Feng, Hui Chen, Tao Hu, Bo |
author_sort | Peng, Yinyin |
collection | PubMed |
description | Most existing point cloud instance segmentation methods require accurate and dense point-level annotations, which are extremely laborious to collect. While incomplete and inexact supervision has been exploited to reduce labeling efforts, inaccurate supervision remains under-explored. This kind of supervision is almost inevitable in practice, especially in complex 3D point clouds, and it severely degrades the generalization performance of deep networks. To this end, we propose the first weakly supervised point cloud instance segmentation framework with inaccurate box-level labels. A novel self-distillation architecture is presented to boost the generalization ability while leveraging the cheap but noisy bounding-box annotations. Specifically, we employ consistency regularization to distill self-knowledge from data perturbation and historical predictions, which prevents the deep network from overfitting the noisy labels. Moreover, we progressively select reliable samples and correct their labels based on the historical consistency. Extensive experiments on the ScanNet-v2 dataset were used to validate the effectiveness and robustness of our method in dealing with inexact and inaccurate annotations. |
format | Online Article Text |
id | pubmed-9960887 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-99608872023-02-26 Point Cloud Instance Segmentation with Inaccurate Bounding-Box Annotations Peng, Yinyin Feng, Hui Chen, Tao Hu, Bo Sensors (Basel) Article Most existing point cloud instance segmentation methods require accurate and dense point-level annotations, which are extremely laborious to collect. While incomplete and inexact supervision has been exploited to reduce labeling efforts, inaccurate supervision remains under-explored. This kind of supervision is almost inevitable in practice, especially in complex 3D point clouds, and it severely degrades the generalization performance of deep networks. To this end, we propose the first weakly supervised point cloud instance segmentation framework with inaccurate box-level labels. A novel self-distillation architecture is presented to boost the generalization ability while leveraging the cheap but noisy bounding-box annotations. Specifically, we employ consistency regularization to distill self-knowledge from data perturbation and historical predictions, which prevents the deep network from overfitting the noisy labels. Moreover, we progressively select reliable samples and correct their labels based on the historical consistency. Extensive experiments on the ScanNet-v2 dataset were used to validate the effectiveness and robustness of our method in dealing with inexact and inaccurate annotations. MDPI 2023-02-20 /pmc/articles/PMC9960887/ /pubmed/36850943 http://dx.doi.org/10.3390/s23042343 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Peng, Yinyin Feng, Hui Chen, Tao Hu, Bo Point Cloud Instance Segmentation with Inaccurate Bounding-Box Annotations |
title | Point Cloud Instance Segmentation with Inaccurate Bounding-Box Annotations |
title_full | Point Cloud Instance Segmentation with Inaccurate Bounding-Box Annotations |
title_fullStr | Point Cloud Instance Segmentation with Inaccurate Bounding-Box Annotations |
title_full_unstemmed | Point Cloud Instance Segmentation with Inaccurate Bounding-Box Annotations |
title_short | Point Cloud Instance Segmentation with Inaccurate Bounding-Box Annotations |
title_sort | point cloud instance segmentation with inaccurate bounding-box annotations |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9960887/ https://www.ncbi.nlm.nih.gov/pubmed/36850943 http://dx.doi.org/10.3390/s23042343 |
work_keys_str_mv | AT pengyinyin pointcloudinstancesegmentationwithinaccurateboundingboxannotations AT fenghui pointcloudinstancesegmentationwithinaccurateboundingboxannotations AT chentao pointcloudinstancesegmentationwithinaccurateboundingboxannotations AT hubo pointcloudinstancesegmentationwithinaccurateboundingboxannotations |