Cargando…

SS-CPGAN: Self-Supervised Cut-and-Pasting Generative Adversarial Network for Object Segmentation

This paper proposes a novel self-supervised based Cut-and-Paste GAN to perform foreground object segmentation and generate realistic composite images without manual annotations. We accomplish this goal by a simple yet effective self-supervised approach coupled with the U-Net discriminator. The propo...

Descripción completa

Detalles Bibliográficos
Autores principales: Chaturvedi, Kunal, Braytee, Ali, Li, Jun, Prasad, Mukesh
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10098536/
https://www.ncbi.nlm.nih.gov/pubmed/37050712
http://dx.doi.org/10.3390/s23073649
_version_ 1785024833389592576
author Chaturvedi, Kunal
Braytee, Ali
Li, Jun
Prasad, Mukesh
author_facet Chaturvedi, Kunal
Braytee, Ali
Li, Jun
Prasad, Mukesh
author_sort Chaturvedi, Kunal
collection PubMed
description This paper proposes a novel self-supervised based Cut-and-Paste GAN to perform foreground object segmentation and generate realistic composite images without manual annotations. We accomplish this goal by a simple yet effective self-supervised approach coupled with the U-Net discriminator. The proposed method extends the ability of the standard discriminators to learn not only the global data representations via classification (real/fake) but also learn semantic and structural information through pseudo labels created using the self-supervised task. The proposed method empowers the generator to create meaningful masks by forcing it to learn informative per-pixel and global image feedback from the discriminator. Our experiments demonstrate that our proposed method significantly outperforms the state-of-the-art methods on the standard benchmark datasets.
format Online
Article
Text
id pubmed-10098536
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-100985362023-04-14 SS-CPGAN: Self-Supervised Cut-and-Pasting Generative Adversarial Network for Object Segmentation Chaturvedi, Kunal Braytee, Ali Li, Jun Prasad, Mukesh Sensors (Basel) Communication This paper proposes a novel self-supervised based Cut-and-Paste GAN to perform foreground object segmentation and generate realistic composite images without manual annotations. We accomplish this goal by a simple yet effective self-supervised approach coupled with the U-Net discriminator. The proposed method extends the ability of the standard discriminators to learn not only the global data representations via classification (real/fake) but also learn semantic and structural information through pseudo labels created using the self-supervised task. The proposed method empowers the generator to create meaningful masks by forcing it to learn informative per-pixel and global image feedback from the discriminator. Our experiments demonstrate that our proposed method significantly outperforms the state-of-the-art methods on the standard benchmark datasets. MDPI 2023-03-31 /pmc/articles/PMC10098536/ /pubmed/37050712 http://dx.doi.org/10.3390/s23073649 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Communication
Chaturvedi, Kunal
Braytee, Ali
Li, Jun
Prasad, Mukesh
SS-CPGAN: Self-Supervised Cut-and-Pasting Generative Adversarial Network for Object Segmentation
title SS-CPGAN: Self-Supervised Cut-and-Pasting Generative Adversarial Network for Object Segmentation
title_full SS-CPGAN: Self-Supervised Cut-and-Pasting Generative Adversarial Network for Object Segmentation
title_fullStr SS-CPGAN: Self-Supervised Cut-and-Pasting Generative Adversarial Network for Object Segmentation
title_full_unstemmed SS-CPGAN: Self-Supervised Cut-and-Pasting Generative Adversarial Network for Object Segmentation
title_short SS-CPGAN: Self-Supervised Cut-and-Pasting Generative Adversarial Network for Object Segmentation
title_sort ss-cpgan: self-supervised cut-and-pasting generative adversarial network for object segmentation
topic Communication
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10098536/
https://www.ncbi.nlm.nih.gov/pubmed/37050712
http://dx.doi.org/10.3390/s23073649
work_keys_str_mv AT chaturvedikunal sscpganselfsupervisedcutandpastinggenerativeadversarialnetworkforobjectsegmentation
AT brayteeali sscpganselfsupervisedcutandpastinggenerativeadversarialnetworkforobjectsegmentation
AT lijun sscpganselfsupervisedcutandpastinggenerativeadversarialnetworkforobjectsegmentation
AT prasadmukesh sscpganselfsupervisedcutandpastinggenerativeadversarialnetworkforobjectsegmentation