Cargando…

GTMNet: a vision transformer with guided transmission map for single remote sensing image dehazing

Existing dehazing algorithms are not effective for remote sensing images (RSIs) with dense haze, and dehazed results are prone to over-enhancement, color distortion, and artifacts. To tackle these problems, we propose a model GTMNet based on convolutional neural networks (CNNs) and vision transforme...

Descripción completa

Detalles Bibliográficos
Autores principales: Li, Haiqin, Zhang, Yaping, Liu, Jiatao, Ma, Yuanjie
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10247807/
https://www.ncbi.nlm.nih.gov/pubmed/37286555
http://dx.doi.org/10.1038/s41598-023-36149-6
_version_ 1785055236912578560
author Li, Haiqin
Zhang, Yaping
Liu, Jiatao
Ma, Yuanjie
author_facet Li, Haiqin
Zhang, Yaping
Liu, Jiatao
Ma, Yuanjie
author_sort Li, Haiqin
collection PubMed
description Existing dehazing algorithms are not effective for remote sensing images (RSIs) with dense haze, and dehazed results are prone to over-enhancement, color distortion, and artifacts. To tackle these problems, we propose a model GTMNet based on convolutional neural networks (CNNs) and vision transformers (ViTs), combined with dark channel prior (DCP) to achieve good performance. Specifically, a spatial feature transform (SFT) layer is first used to smoothly introduce the guided transmission map (GTM) into the model, improving the ability of the network to estimate haze thickness. A strengthen-operate-subtract (SOS) boosted module is then added to refine the local features of the restored image. The framework of GTMNet is determined by adjusting the input of the SOS boosted module and the position of the SFT layer. On SateHaze1k dataset, we compare GTMNet with several classical dehazing algorithms. The results show that on sub-datasets of Moderate Fog and Thick Fog, the PSNR and SSIM of GTMNet-B are comparable to that of the state-of-the-art model Dehazeformer-L, with only 0.1 times of parameter quantity. In addition, our method is intuitively effective in improving the clarity and the details of dehazed images, which proves the usefulness and significance of using the prior GTM and the SOS boosted module in a single RSI dehazing.
format Online
Article
Text
id pubmed-10247807
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-102478072023-06-09 GTMNet: a vision transformer with guided transmission map for single remote sensing image dehazing Li, Haiqin Zhang, Yaping Liu, Jiatao Ma, Yuanjie Sci Rep Article Existing dehazing algorithms are not effective for remote sensing images (RSIs) with dense haze, and dehazed results are prone to over-enhancement, color distortion, and artifacts. To tackle these problems, we propose a model GTMNet based on convolutional neural networks (CNNs) and vision transformers (ViTs), combined with dark channel prior (DCP) to achieve good performance. Specifically, a spatial feature transform (SFT) layer is first used to smoothly introduce the guided transmission map (GTM) into the model, improving the ability of the network to estimate haze thickness. A strengthen-operate-subtract (SOS) boosted module is then added to refine the local features of the restored image. The framework of GTMNet is determined by adjusting the input of the SOS boosted module and the position of the SFT layer. On SateHaze1k dataset, we compare GTMNet with several classical dehazing algorithms. The results show that on sub-datasets of Moderate Fog and Thick Fog, the PSNR and SSIM of GTMNet-B are comparable to that of the state-of-the-art model Dehazeformer-L, with only 0.1 times of parameter quantity. In addition, our method is intuitively effective in improving the clarity and the details of dehazed images, which proves the usefulness and significance of using the prior GTM and the SOS boosted module in a single RSI dehazing. Nature Publishing Group UK 2023-06-07 /pmc/articles/PMC10247807/ /pubmed/37286555 http://dx.doi.org/10.1038/s41598-023-36149-6 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Li, Haiqin
Zhang, Yaping
Liu, Jiatao
Ma, Yuanjie
GTMNet: a vision transformer with guided transmission map for single remote sensing image dehazing
title GTMNet: a vision transformer with guided transmission map for single remote sensing image dehazing
title_full GTMNet: a vision transformer with guided transmission map for single remote sensing image dehazing
title_fullStr GTMNet: a vision transformer with guided transmission map for single remote sensing image dehazing
title_full_unstemmed GTMNet: a vision transformer with guided transmission map for single remote sensing image dehazing
title_short GTMNet: a vision transformer with guided transmission map for single remote sensing image dehazing
title_sort gtmnet: a vision transformer with guided transmission map for single remote sensing image dehazing
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10247807/
https://www.ncbi.nlm.nih.gov/pubmed/37286555
http://dx.doi.org/10.1038/s41598-023-36149-6
work_keys_str_mv AT lihaiqin gtmnetavisiontransformerwithguidedtransmissionmapforsingleremotesensingimagedehazing
AT zhangyaping gtmnetavisiontransformerwithguidedtransmissionmapforsingleremotesensingimagedehazing
AT liujiatao gtmnetavisiontransformerwithguidedtransmissionmapforsingleremotesensingimagedehazing
AT mayuanjie gtmnetavisiontransformerwithguidedtransmissionmapforsingleremotesensingimagedehazing