Cargando…
SUGAN: A Stable U-Net Based Generative Adversarial Network
As one of the representative models in the field of image generation, generative adversarial networks (GANs) face a significant challenge: how to make the best trade-off between the quality of generated images and training stability. The U-Net based GAN (U-Net GAN), a recently developed approach, ca...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10490267/ https://www.ncbi.nlm.nih.gov/pubmed/37687794 http://dx.doi.org/10.3390/s23177338 |
_version_ | 1785103804632399872 |
---|---|
author | Cheng, Shijie Wang, Lingfeng Zhang, Min Zeng, Cheng Meng, Yan |
author_facet | Cheng, Shijie Wang, Lingfeng Zhang, Min Zeng, Cheng Meng, Yan |
author_sort | Cheng, Shijie |
collection | PubMed |
description | As one of the representative models in the field of image generation, generative adversarial networks (GANs) face a significant challenge: how to make the best trade-off between the quality of generated images and training stability. The U-Net based GAN (U-Net GAN), a recently developed approach, can generate high-quality synthetic images by using a U-Net architecture for the discriminator. However, this model may suffer from severe mode collapse. In this study, a stable U-Net GAN (SUGAN) is proposed to mainly solve this problem. First, a gradient normalization module is introduced to the discriminator of U-Net GAN. This module effectively reduces gradient magnitudes, thereby greatly alleviating the problems of gradient instability and overfitting. As a result, the training stability of the GAN model is improved. Additionally, in order to solve the problem of blurred edges of the generated images, a modified residual network is used in the generator. This modification enhances its ability to capture image details, leading to higher-definition generated images. Extensive experiments conducted on several datasets show that the proposed SUGAN significantly improves over the Inception Score (IS) and Fréchet Inception Distance (FID) metrics compared with several state-of-the-art and classic GANs. The training process of our SUGAN is stable, and the quality and diversity of the generated samples are higher. This clearly demonstrates the effectiveness of our approach for image generation tasks. The source code and trained model of our SUGAN have been publicly released. |
format | Online Article Text |
id | pubmed-10490267 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-104902672023-09-09 SUGAN: A Stable U-Net Based Generative Adversarial Network Cheng, Shijie Wang, Lingfeng Zhang, Min Zeng, Cheng Meng, Yan Sensors (Basel) Article As one of the representative models in the field of image generation, generative adversarial networks (GANs) face a significant challenge: how to make the best trade-off between the quality of generated images and training stability. The U-Net based GAN (U-Net GAN), a recently developed approach, can generate high-quality synthetic images by using a U-Net architecture for the discriminator. However, this model may suffer from severe mode collapse. In this study, a stable U-Net GAN (SUGAN) is proposed to mainly solve this problem. First, a gradient normalization module is introduced to the discriminator of U-Net GAN. This module effectively reduces gradient magnitudes, thereby greatly alleviating the problems of gradient instability and overfitting. As a result, the training stability of the GAN model is improved. Additionally, in order to solve the problem of blurred edges of the generated images, a modified residual network is used in the generator. This modification enhances its ability to capture image details, leading to higher-definition generated images. Extensive experiments conducted on several datasets show that the proposed SUGAN significantly improves over the Inception Score (IS) and Fréchet Inception Distance (FID) metrics compared with several state-of-the-art and classic GANs. The training process of our SUGAN is stable, and the quality and diversity of the generated samples are higher. This clearly demonstrates the effectiveness of our approach for image generation tasks. The source code and trained model of our SUGAN have been publicly released. MDPI 2023-08-23 /pmc/articles/PMC10490267/ /pubmed/37687794 http://dx.doi.org/10.3390/s23177338 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Cheng, Shijie Wang, Lingfeng Zhang, Min Zeng, Cheng Meng, Yan SUGAN: A Stable U-Net Based Generative Adversarial Network |
title | SUGAN: A Stable U-Net Based Generative Adversarial Network |
title_full | SUGAN: A Stable U-Net Based Generative Adversarial Network |
title_fullStr | SUGAN: A Stable U-Net Based Generative Adversarial Network |
title_full_unstemmed | SUGAN: A Stable U-Net Based Generative Adversarial Network |
title_short | SUGAN: A Stable U-Net Based Generative Adversarial Network |
title_sort | sugan: a stable u-net based generative adversarial network |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10490267/ https://www.ncbi.nlm.nih.gov/pubmed/37687794 http://dx.doi.org/10.3390/s23177338 |
work_keys_str_mv | AT chengshijie suganastableunetbasedgenerativeadversarialnetwork AT wanglingfeng suganastableunetbasedgenerativeadversarialnetwork AT zhangmin suganastableunetbasedgenerativeadversarialnetwork AT zengcheng suganastableunetbasedgenerativeadversarialnetwork AT mengyan suganastableunetbasedgenerativeadversarialnetwork |