Cargando…

PRAGAN: Progressive Recurrent Attention GAN with Pretrained ViT Discriminator for Single-Image Deraining

Images captured in bad weather are not conducive to visual tasks. Rain streaks in rainy images will significantly affect the regular operation of imaging equipment; to solve this problem, using multiple neural networks is a trend. The ingenious integration of network structures allows for full use o...

Descripción completa

Detalles Bibliográficos
Autores principales: Wei, Bingcai, Wang, Di, Wang, Zhuang, Zhang, Liye
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9785271/
https://www.ncbi.nlm.nih.gov/pubmed/36559956
http://dx.doi.org/10.3390/s22249587
_version_ 1784858008486936576
author Wei, Bingcai
Wang, Di
Wang, Zhuang
Zhang, Liye
author_facet Wei, Bingcai
Wang, Di
Wang, Zhuang
Zhang, Liye
author_sort Wei, Bingcai
collection PubMed
description Images captured in bad weather are not conducive to visual tasks. Rain streaks in rainy images will significantly affect the regular operation of imaging equipment; to solve this problem, using multiple neural networks is a trend. The ingenious integration of network structures allows for full use of the powerful representation and fitting abilities of deep learning to complete low-level visual tasks. In this study, we propose a generative adversarial network (GAN) with multiple attention mechanisms for image rain removal tasks. Firstly, to the best of our knowledge, we propose a pretrained vision transformer (ViT) as the discriminator in GAN for single-image rain removal for the first time. Secondly, we propose a neural network training method that can use a small amount of data for training while maintaining promising results and reliable visual quality. A large number of experiments prove the correctness and effectiveness of our method. Our proposed method achieves better results on synthetic and real image datasets than multiple state-of-the-art methods, even when using less training data.
format Online
Article
Text
id pubmed-9785271
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-97852712022-12-24 PRAGAN: Progressive Recurrent Attention GAN with Pretrained ViT Discriminator for Single-Image Deraining Wei, Bingcai Wang, Di Wang, Zhuang Zhang, Liye Sensors (Basel) Article Images captured in bad weather are not conducive to visual tasks. Rain streaks in rainy images will significantly affect the regular operation of imaging equipment; to solve this problem, using multiple neural networks is a trend. The ingenious integration of network structures allows for full use of the powerful representation and fitting abilities of deep learning to complete low-level visual tasks. In this study, we propose a generative adversarial network (GAN) with multiple attention mechanisms for image rain removal tasks. Firstly, to the best of our knowledge, we propose a pretrained vision transformer (ViT) as the discriminator in GAN for single-image rain removal for the first time. Secondly, we propose a neural network training method that can use a small amount of data for training while maintaining promising results and reliable visual quality. A large number of experiments prove the correctness and effectiveness of our method. Our proposed method achieves better results on synthetic and real image datasets than multiple state-of-the-art methods, even when using less training data. MDPI 2022-12-07 /pmc/articles/PMC9785271/ /pubmed/36559956 http://dx.doi.org/10.3390/s22249587 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Wei, Bingcai
Wang, Di
Wang, Zhuang
Zhang, Liye
PRAGAN: Progressive Recurrent Attention GAN with Pretrained ViT Discriminator for Single-Image Deraining
title PRAGAN: Progressive Recurrent Attention GAN with Pretrained ViT Discriminator for Single-Image Deraining
title_full PRAGAN: Progressive Recurrent Attention GAN with Pretrained ViT Discriminator for Single-Image Deraining
title_fullStr PRAGAN: Progressive Recurrent Attention GAN with Pretrained ViT Discriminator for Single-Image Deraining
title_full_unstemmed PRAGAN: Progressive Recurrent Attention GAN with Pretrained ViT Discriminator for Single-Image Deraining
title_short PRAGAN: Progressive Recurrent Attention GAN with Pretrained ViT Discriminator for Single-Image Deraining
title_sort pragan: progressive recurrent attention gan with pretrained vit discriminator for single-image deraining
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9785271/
https://www.ncbi.nlm.nih.gov/pubmed/36559956
http://dx.doi.org/10.3390/s22249587
work_keys_str_mv AT weibingcai praganprogressiverecurrentattentionganwithpretrainedvitdiscriminatorforsingleimagederaining
AT wangdi praganprogressiverecurrentattentionganwithpretrainedvitdiscriminatorforsingleimagederaining
AT wangzhuang praganprogressiverecurrentattentionganwithpretrainedvitdiscriminatorforsingleimagederaining
AT zhangliye praganprogressiverecurrentattentionganwithpretrainedvitdiscriminatorforsingleimagederaining