Cargando…
GTMNet: a vision transformer with guided transmission map for single remote sensing image dehazing
Existing dehazing algorithms are not effective for remote sensing images (RSIs) with dense haze, and dehazed results are prone to over-enhancement, color distortion, and artifacts. To tackle these problems, we propose a model GTMNet based on convolutional neural networks (CNNs) and vision transforme...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10247807/ https://www.ncbi.nlm.nih.gov/pubmed/37286555 http://dx.doi.org/10.1038/s41598-023-36149-6 |
_version_ | 1785055236912578560 |
---|---|
author | Li, Haiqin Zhang, Yaping Liu, Jiatao Ma, Yuanjie |
author_facet | Li, Haiqin Zhang, Yaping Liu, Jiatao Ma, Yuanjie |
author_sort | Li, Haiqin |
collection | PubMed |
description | Existing dehazing algorithms are not effective for remote sensing images (RSIs) with dense haze, and dehazed results are prone to over-enhancement, color distortion, and artifacts. To tackle these problems, we propose a model GTMNet based on convolutional neural networks (CNNs) and vision transformers (ViTs), combined with dark channel prior (DCP) to achieve good performance. Specifically, a spatial feature transform (SFT) layer is first used to smoothly introduce the guided transmission map (GTM) into the model, improving the ability of the network to estimate haze thickness. A strengthen-operate-subtract (SOS) boosted module is then added to refine the local features of the restored image. The framework of GTMNet is determined by adjusting the input of the SOS boosted module and the position of the SFT layer. On SateHaze1k dataset, we compare GTMNet with several classical dehazing algorithms. The results show that on sub-datasets of Moderate Fog and Thick Fog, the PSNR and SSIM of GTMNet-B are comparable to that of the state-of-the-art model Dehazeformer-L, with only 0.1 times of parameter quantity. In addition, our method is intuitively effective in improving the clarity and the details of dehazed images, which proves the usefulness and significance of using the prior GTM and the SOS boosted module in a single RSI dehazing. |
format | Online Article Text |
id | pubmed-10247807 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-102478072023-06-09 GTMNet: a vision transformer with guided transmission map for single remote sensing image dehazing Li, Haiqin Zhang, Yaping Liu, Jiatao Ma, Yuanjie Sci Rep Article Existing dehazing algorithms are not effective for remote sensing images (RSIs) with dense haze, and dehazed results are prone to over-enhancement, color distortion, and artifacts. To tackle these problems, we propose a model GTMNet based on convolutional neural networks (CNNs) and vision transformers (ViTs), combined with dark channel prior (DCP) to achieve good performance. Specifically, a spatial feature transform (SFT) layer is first used to smoothly introduce the guided transmission map (GTM) into the model, improving the ability of the network to estimate haze thickness. A strengthen-operate-subtract (SOS) boosted module is then added to refine the local features of the restored image. The framework of GTMNet is determined by adjusting the input of the SOS boosted module and the position of the SFT layer. On SateHaze1k dataset, we compare GTMNet with several classical dehazing algorithms. The results show that on sub-datasets of Moderate Fog and Thick Fog, the PSNR and SSIM of GTMNet-B are comparable to that of the state-of-the-art model Dehazeformer-L, with only 0.1 times of parameter quantity. In addition, our method is intuitively effective in improving the clarity and the details of dehazed images, which proves the usefulness and significance of using the prior GTM and the SOS boosted module in a single RSI dehazing. Nature Publishing Group UK 2023-06-07 /pmc/articles/PMC10247807/ /pubmed/37286555 http://dx.doi.org/10.1038/s41598-023-36149-6 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . |
spellingShingle | Article Li, Haiqin Zhang, Yaping Liu, Jiatao Ma, Yuanjie GTMNet: a vision transformer with guided transmission map for single remote sensing image dehazing |
title | GTMNet: a vision transformer with guided transmission map for single remote sensing image dehazing |
title_full | GTMNet: a vision transformer with guided transmission map for single remote sensing image dehazing |
title_fullStr | GTMNet: a vision transformer with guided transmission map for single remote sensing image dehazing |
title_full_unstemmed | GTMNet: a vision transformer with guided transmission map for single remote sensing image dehazing |
title_short | GTMNet: a vision transformer with guided transmission map for single remote sensing image dehazing |
title_sort | gtmnet: a vision transformer with guided transmission map for single remote sensing image dehazing |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10247807/ https://www.ncbi.nlm.nih.gov/pubmed/37286555 http://dx.doi.org/10.1038/s41598-023-36149-6 |
work_keys_str_mv | AT lihaiqin gtmnetavisiontransformerwithguidedtransmissionmapforsingleremotesensingimagedehazing AT zhangyaping gtmnetavisiontransformerwithguidedtransmissionmapforsingleremotesensingimagedehazing AT liujiatao gtmnetavisiontransformerwithguidedtransmissionmapforsingleremotesensingimagedehazing AT mayuanjie gtmnetavisiontransformerwithguidedtransmissionmapforsingleremotesensingimagedehazing |