Cargando…
SS-CPGAN: Self-Supervised Cut-and-Pasting Generative Adversarial Network for Object Segmentation
This paper proposes a novel self-supervised based Cut-and-Paste GAN to perform foreground object segmentation and generate realistic composite images without manual annotations. We accomplish this goal by a simple yet effective self-supervised approach coupled with the U-Net discriminator. The propo...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10098536/ https://www.ncbi.nlm.nih.gov/pubmed/37050712 http://dx.doi.org/10.3390/s23073649 |
_version_ | 1785024833389592576 |
---|---|
author | Chaturvedi, Kunal Braytee, Ali Li, Jun Prasad, Mukesh |
author_facet | Chaturvedi, Kunal Braytee, Ali Li, Jun Prasad, Mukesh |
author_sort | Chaturvedi, Kunal |
collection | PubMed |
description | This paper proposes a novel self-supervised based Cut-and-Paste GAN to perform foreground object segmentation and generate realistic composite images without manual annotations. We accomplish this goal by a simple yet effective self-supervised approach coupled with the U-Net discriminator. The proposed method extends the ability of the standard discriminators to learn not only the global data representations via classification (real/fake) but also learn semantic and structural information through pseudo labels created using the self-supervised task. The proposed method empowers the generator to create meaningful masks by forcing it to learn informative per-pixel and global image feedback from the discriminator. Our experiments demonstrate that our proposed method significantly outperforms the state-of-the-art methods on the standard benchmark datasets. |
format | Online Article Text |
id | pubmed-10098536 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-100985362023-04-14 SS-CPGAN: Self-Supervised Cut-and-Pasting Generative Adversarial Network for Object Segmentation Chaturvedi, Kunal Braytee, Ali Li, Jun Prasad, Mukesh Sensors (Basel) Communication This paper proposes a novel self-supervised based Cut-and-Paste GAN to perform foreground object segmentation and generate realistic composite images without manual annotations. We accomplish this goal by a simple yet effective self-supervised approach coupled with the U-Net discriminator. The proposed method extends the ability of the standard discriminators to learn not only the global data representations via classification (real/fake) but also learn semantic and structural information through pseudo labels created using the self-supervised task. The proposed method empowers the generator to create meaningful masks by forcing it to learn informative per-pixel and global image feedback from the discriminator. Our experiments demonstrate that our proposed method significantly outperforms the state-of-the-art methods on the standard benchmark datasets. MDPI 2023-03-31 /pmc/articles/PMC10098536/ /pubmed/37050712 http://dx.doi.org/10.3390/s23073649 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Communication Chaturvedi, Kunal Braytee, Ali Li, Jun Prasad, Mukesh SS-CPGAN: Self-Supervised Cut-and-Pasting Generative Adversarial Network for Object Segmentation |
title | SS-CPGAN: Self-Supervised Cut-and-Pasting Generative Adversarial Network for Object Segmentation |
title_full | SS-CPGAN: Self-Supervised Cut-and-Pasting Generative Adversarial Network for Object Segmentation |
title_fullStr | SS-CPGAN: Self-Supervised Cut-and-Pasting Generative Adversarial Network for Object Segmentation |
title_full_unstemmed | SS-CPGAN: Self-Supervised Cut-and-Pasting Generative Adversarial Network for Object Segmentation |
title_short | SS-CPGAN: Self-Supervised Cut-and-Pasting Generative Adversarial Network for Object Segmentation |
title_sort | ss-cpgan: self-supervised cut-and-pasting generative adversarial network for object segmentation |
topic | Communication |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10098536/ https://www.ncbi.nlm.nih.gov/pubmed/37050712 http://dx.doi.org/10.3390/s23073649 |
work_keys_str_mv | AT chaturvedikunal sscpganselfsupervisedcutandpastinggenerativeadversarialnetworkforobjectsegmentation AT brayteeali sscpganselfsupervisedcutandpastinggenerativeadversarialnetworkforobjectsegmentation AT lijun sscpganselfsupervisedcutandpastinggenerativeadversarialnetworkforobjectsegmentation AT prasadmukesh sscpganselfsupervisedcutandpastinggenerativeadversarialnetworkforobjectsegmentation |