Cargando…
Residual Spatial and Channel Attention Networks for Single Image Dehazing
Single image dehazing is a highly challenging ill-posed problem. Existing methods including both prior-based and learning-based heavily rely on the conceptual simplified atmospheric scattering model by estimating the so-called medium transmission map and atmospheric light. However, the formation of...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8659565/ https://www.ncbi.nlm.nih.gov/pubmed/34883928 http://dx.doi.org/10.3390/s21237922 |
_version_ | 1784612993198194688 |
---|---|
author | Jiang, Xin Zhao, Chunlei Zhu, Ming Hao, Zhicheng Gao, Wen |
author_facet | Jiang, Xin Zhao, Chunlei Zhu, Ming Hao, Zhicheng Gao, Wen |
author_sort | Jiang, Xin |
collection | PubMed |
description | Single image dehazing is a highly challenging ill-posed problem. Existing methods including both prior-based and learning-based heavily rely on the conceptual simplified atmospheric scattering model by estimating the so-called medium transmission map and atmospheric light. However, the formation of haze in the real world is much more complicated and inaccurate estimations further degrade the dehazing performance with color distortion, artifacts and insufficient haze removal. Moreover, most dehazing networks treat spatial-wise and channel-wise features equally, but haze is practically unevenly distributed across an image, thus regions with different haze concentrations require different attentions. To solve these problems, we propose an end-to-end trainable densely connected residual spatial and channel attention network based on the conditional generative adversarial framework to directly restore a haze-free image from an input hazy image, without explicitly estimation of any atmospheric scattering parameters. Specifically, a novel residual attention module is proposed by combining spatial attention and channel attention mechanism, which could adaptively recalibrate spatial-wise and channel-wise feature weights by considering interdependencies among spatial and channel information. Such a mechanism allows the network to concentrate on more useful pixels and channels. Meanwhile, the dense network can maximize the information flow along features from different levels to encourage feature reuse and strengthen feature propagation. In addition, the network is trained with a multi-loss function, in which contrastive loss and registration loss are novel refined to restore sharper structures and ensure better visual quality. Experimental results demonstrate that the proposed method achieves the state-of-the-art performance on both public synthetic datasets and real-world images with more visually pleasing dehazed results. |
format | Online Article Text |
id | pubmed-8659565 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-86595652021-12-10 Residual Spatial and Channel Attention Networks for Single Image Dehazing Jiang, Xin Zhao, Chunlei Zhu, Ming Hao, Zhicheng Gao, Wen Sensors (Basel) Article Single image dehazing is a highly challenging ill-posed problem. Existing methods including both prior-based and learning-based heavily rely on the conceptual simplified atmospheric scattering model by estimating the so-called medium transmission map and atmospheric light. However, the formation of haze in the real world is much more complicated and inaccurate estimations further degrade the dehazing performance with color distortion, artifacts and insufficient haze removal. Moreover, most dehazing networks treat spatial-wise and channel-wise features equally, but haze is practically unevenly distributed across an image, thus regions with different haze concentrations require different attentions. To solve these problems, we propose an end-to-end trainable densely connected residual spatial and channel attention network based on the conditional generative adversarial framework to directly restore a haze-free image from an input hazy image, without explicitly estimation of any atmospheric scattering parameters. Specifically, a novel residual attention module is proposed by combining spatial attention and channel attention mechanism, which could adaptively recalibrate spatial-wise and channel-wise feature weights by considering interdependencies among spatial and channel information. Such a mechanism allows the network to concentrate on more useful pixels and channels. Meanwhile, the dense network can maximize the information flow along features from different levels to encourage feature reuse and strengthen feature propagation. In addition, the network is trained with a multi-loss function, in which contrastive loss and registration loss are novel refined to restore sharper structures and ensure better visual quality. Experimental results demonstrate that the proposed method achieves the state-of-the-art performance on both public synthetic datasets and real-world images with more visually pleasing dehazed results. MDPI 2021-11-27 /pmc/articles/PMC8659565/ /pubmed/34883928 http://dx.doi.org/10.3390/s21237922 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Jiang, Xin Zhao, Chunlei Zhu, Ming Hao, Zhicheng Gao, Wen Residual Spatial and Channel Attention Networks for Single Image Dehazing |
title | Residual Spatial and Channel Attention Networks for Single Image Dehazing |
title_full | Residual Spatial and Channel Attention Networks for Single Image Dehazing |
title_fullStr | Residual Spatial and Channel Attention Networks for Single Image Dehazing |
title_full_unstemmed | Residual Spatial and Channel Attention Networks for Single Image Dehazing |
title_short | Residual Spatial and Channel Attention Networks for Single Image Dehazing |
title_sort | residual spatial and channel attention networks for single image dehazing |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8659565/ https://www.ncbi.nlm.nih.gov/pubmed/34883928 http://dx.doi.org/10.3390/s21237922 |
work_keys_str_mv | AT jiangxin residualspatialandchannelattentionnetworksforsingleimagedehazing AT zhaochunlei residualspatialandchannelattentionnetworksforsingleimagedehazing AT zhuming residualspatialandchannelattentionnetworksforsingleimagedehazing AT haozhicheng residualspatialandchannelattentionnetworksforsingleimagedehazing AT gaowen residualspatialandchannelattentionnetworksforsingleimagedehazing |