Cargando…

SUGAN: A Stable U-Net Based Generative Adversarial Network

As one of the representative models in the field of image generation, generative adversarial networks (GANs) face a significant challenge: how to make the best trade-off between the quality of generated images and training stability. The U-Net based GAN (U-Net GAN), a recently developed approach, ca...

Descripción completa

Detalles Bibliográficos
Autores principales: Cheng, Shijie, Wang, Lingfeng, Zhang, Min, Zeng, Cheng, Meng, Yan
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10490267/
https://www.ncbi.nlm.nih.gov/pubmed/37687794
http://dx.doi.org/10.3390/s23177338
_version_ 1785103804632399872
author Cheng, Shijie
Wang, Lingfeng
Zhang, Min
Zeng, Cheng
Meng, Yan
author_facet Cheng, Shijie
Wang, Lingfeng
Zhang, Min
Zeng, Cheng
Meng, Yan
author_sort Cheng, Shijie
collection PubMed
description As one of the representative models in the field of image generation, generative adversarial networks (GANs) face a significant challenge: how to make the best trade-off between the quality of generated images and training stability. The U-Net based GAN (U-Net GAN), a recently developed approach, can generate high-quality synthetic images by using a U-Net architecture for the discriminator. However, this model may suffer from severe mode collapse. In this study, a stable U-Net GAN (SUGAN) is proposed to mainly solve this problem. First, a gradient normalization module is introduced to the discriminator of U-Net GAN. This module effectively reduces gradient magnitudes, thereby greatly alleviating the problems of gradient instability and overfitting. As a result, the training stability of the GAN model is improved. Additionally, in order to solve the problem of blurred edges of the generated images, a modified residual network is used in the generator. This modification enhances its ability to capture image details, leading to higher-definition generated images. Extensive experiments conducted on several datasets show that the proposed SUGAN significantly improves over the Inception Score (IS) and Fréchet Inception Distance (FID) metrics compared with several state-of-the-art and classic GANs. The training process of our SUGAN is stable, and the quality and diversity of the generated samples are higher. This clearly demonstrates the effectiveness of our approach for image generation tasks. The source code and trained model of our SUGAN have been publicly released.
format Online
Article
Text
id pubmed-10490267
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-104902672023-09-09 SUGAN: A Stable U-Net Based Generative Adversarial Network Cheng, Shijie Wang, Lingfeng Zhang, Min Zeng, Cheng Meng, Yan Sensors (Basel) Article As one of the representative models in the field of image generation, generative adversarial networks (GANs) face a significant challenge: how to make the best trade-off between the quality of generated images and training stability. The U-Net based GAN (U-Net GAN), a recently developed approach, can generate high-quality synthetic images by using a U-Net architecture for the discriminator. However, this model may suffer from severe mode collapse. In this study, a stable U-Net GAN (SUGAN) is proposed to mainly solve this problem. First, a gradient normalization module is introduced to the discriminator of U-Net GAN. This module effectively reduces gradient magnitudes, thereby greatly alleviating the problems of gradient instability and overfitting. As a result, the training stability of the GAN model is improved. Additionally, in order to solve the problem of blurred edges of the generated images, a modified residual network is used in the generator. This modification enhances its ability to capture image details, leading to higher-definition generated images. Extensive experiments conducted on several datasets show that the proposed SUGAN significantly improves over the Inception Score (IS) and Fréchet Inception Distance (FID) metrics compared with several state-of-the-art and classic GANs. The training process of our SUGAN is stable, and the quality and diversity of the generated samples are higher. This clearly demonstrates the effectiveness of our approach for image generation tasks. The source code and trained model of our SUGAN have been publicly released. MDPI 2023-08-23 /pmc/articles/PMC10490267/ /pubmed/37687794 http://dx.doi.org/10.3390/s23177338 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Cheng, Shijie
Wang, Lingfeng
Zhang, Min
Zeng, Cheng
Meng, Yan
SUGAN: A Stable U-Net Based Generative Adversarial Network
title SUGAN: A Stable U-Net Based Generative Adversarial Network
title_full SUGAN: A Stable U-Net Based Generative Adversarial Network
title_fullStr SUGAN: A Stable U-Net Based Generative Adversarial Network
title_full_unstemmed SUGAN: A Stable U-Net Based Generative Adversarial Network
title_short SUGAN: A Stable U-Net Based Generative Adversarial Network
title_sort sugan: a stable u-net based generative adversarial network
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10490267/
https://www.ncbi.nlm.nih.gov/pubmed/37687794
http://dx.doi.org/10.3390/s23177338
work_keys_str_mv AT chengshijie suganastableunetbasedgenerativeadversarialnetwork
AT wanglingfeng suganastableunetbasedgenerativeadversarialnetwork
AT zhangmin suganastableunetbasedgenerativeadversarialnetwork
AT zengcheng suganastableunetbasedgenerativeadversarialnetwork
AT mengyan suganastableunetbasedgenerativeadversarialnetwork