Cargando…
PRAGAN: Progressive Recurrent Attention GAN with Pretrained ViT Discriminator for Single-Image Deraining
Images captured in bad weather are not conducive to visual tasks. Rain streaks in rainy images will significantly affect the regular operation of imaging equipment; to solve this problem, using multiple neural networks is a trend. The ingenious integration of network structures allows for full use o...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9785271/ https://www.ncbi.nlm.nih.gov/pubmed/36559956 http://dx.doi.org/10.3390/s22249587 |
_version_ | 1784858008486936576 |
---|---|
author | Wei, Bingcai Wang, Di Wang, Zhuang Zhang, Liye |
author_facet | Wei, Bingcai Wang, Di Wang, Zhuang Zhang, Liye |
author_sort | Wei, Bingcai |
collection | PubMed |
description | Images captured in bad weather are not conducive to visual tasks. Rain streaks in rainy images will significantly affect the regular operation of imaging equipment; to solve this problem, using multiple neural networks is a trend. The ingenious integration of network structures allows for full use of the powerful representation and fitting abilities of deep learning to complete low-level visual tasks. In this study, we propose a generative adversarial network (GAN) with multiple attention mechanisms for image rain removal tasks. Firstly, to the best of our knowledge, we propose a pretrained vision transformer (ViT) as the discriminator in GAN for single-image rain removal for the first time. Secondly, we propose a neural network training method that can use a small amount of data for training while maintaining promising results and reliable visual quality. A large number of experiments prove the correctness and effectiveness of our method. Our proposed method achieves better results on synthetic and real image datasets than multiple state-of-the-art methods, even when using less training data. |
format | Online Article Text |
id | pubmed-9785271 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-97852712022-12-24 PRAGAN: Progressive Recurrent Attention GAN with Pretrained ViT Discriminator for Single-Image Deraining Wei, Bingcai Wang, Di Wang, Zhuang Zhang, Liye Sensors (Basel) Article Images captured in bad weather are not conducive to visual tasks. Rain streaks in rainy images will significantly affect the regular operation of imaging equipment; to solve this problem, using multiple neural networks is a trend. The ingenious integration of network structures allows for full use of the powerful representation and fitting abilities of deep learning to complete low-level visual tasks. In this study, we propose a generative adversarial network (GAN) with multiple attention mechanisms for image rain removal tasks. Firstly, to the best of our knowledge, we propose a pretrained vision transformer (ViT) as the discriminator in GAN for single-image rain removal for the first time. Secondly, we propose a neural network training method that can use a small amount of data for training while maintaining promising results and reliable visual quality. A large number of experiments prove the correctness and effectiveness of our method. Our proposed method achieves better results on synthetic and real image datasets than multiple state-of-the-art methods, even when using less training data. MDPI 2022-12-07 /pmc/articles/PMC9785271/ /pubmed/36559956 http://dx.doi.org/10.3390/s22249587 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Wei, Bingcai Wang, Di Wang, Zhuang Zhang, Liye PRAGAN: Progressive Recurrent Attention GAN with Pretrained ViT Discriminator for Single-Image Deraining |
title | PRAGAN: Progressive Recurrent Attention GAN with Pretrained ViT Discriminator for Single-Image Deraining |
title_full | PRAGAN: Progressive Recurrent Attention GAN with Pretrained ViT Discriminator for Single-Image Deraining |
title_fullStr | PRAGAN: Progressive Recurrent Attention GAN with Pretrained ViT Discriminator for Single-Image Deraining |
title_full_unstemmed | PRAGAN: Progressive Recurrent Attention GAN with Pretrained ViT Discriminator for Single-Image Deraining |
title_short | PRAGAN: Progressive Recurrent Attention GAN with Pretrained ViT Discriminator for Single-Image Deraining |
title_sort | pragan: progressive recurrent attention gan with pretrained vit discriminator for single-image deraining |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9785271/ https://www.ncbi.nlm.nih.gov/pubmed/36559956 http://dx.doi.org/10.3390/s22249587 |
work_keys_str_mv | AT weibingcai praganprogressiverecurrentattentionganwithpretrainedvitdiscriminatorforsingleimagederaining AT wangdi praganprogressiverecurrentattentionganwithpretrainedvitdiscriminatorforsingleimagederaining AT wangzhuang praganprogressiverecurrentattentionganwithpretrainedvitdiscriminatorforsingleimagederaining AT zhangliye praganprogressiverecurrentattentionganwithpretrainedvitdiscriminatorforsingleimagederaining |