Cargando…

Residual Spatial and Channel Attention Networks for Single Image Dehazing

Single image dehazing is a highly challenging ill-posed problem. Existing methods including both prior-based and learning-based heavily rely on the conceptual simplified atmospheric scattering model by estimating the so-called medium transmission map and atmospheric light. However, the formation of...

Descripción completa

Detalles Bibliográficos
Autores principales: Jiang, Xin, Zhao, Chunlei, Zhu, Ming, Hao, Zhicheng, Gao, Wen
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8659565/
https://www.ncbi.nlm.nih.gov/pubmed/34883928
http://dx.doi.org/10.3390/s21237922
_version_ 1784612993198194688
author Jiang, Xin
Zhao, Chunlei
Zhu, Ming
Hao, Zhicheng
Gao, Wen
author_facet Jiang, Xin
Zhao, Chunlei
Zhu, Ming
Hao, Zhicheng
Gao, Wen
author_sort Jiang, Xin
collection PubMed
description Single image dehazing is a highly challenging ill-posed problem. Existing methods including both prior-based and learning-based heavily rely on the conceptual simplified atmospheric scattering model by estimating the so-called medium transmission map and atmospheric light. However, the formation of haze in the real world is much more complicated and inaccurate estimations further degrade the dehazing performance with color distortion, artifacts and insufficient haze removal. Moreover, most dehazing networks treat spatial-wise and channel-wise features equally, but haze is practically unevenly distributed across an image, thus regions with different haze concentrations require different attentions. To solve these problems, we propose an end-to-end trainable densely connected residual spatial and channel attention network based on the conditional generative adversarial framework to directly restore a haze-free image from an input hazy image, without explicitly estimation of any atmospheric scattering parameters. Specifically, a novel residual attention module is proposed by combining spatial attention and channel attention mechanism, which could adaptively recalibrate spatial-wise and channel-wise feature weights by considering interdependencies among spatial and channel information. Such a mechanism allows the network to concentrate on more useful pixels and channels. Meanwhile, the dense network can maximize the information flow along features from different levels to encourage feature reuse and strengthen feature propagation. In addition, the network is trained with a multi-loss function, in which contrastive loss and registration loss are novel refined to restore sharper structures and ensure better visual quality. Experimental results demonstrate that the proposed method achieves the state-of-the-art performance on both public synthetic datasets and real-world images with more visually pleasing dehazed results.
format Online
Article
Text
id pubmed-8659565
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-86595652021-12-10 Residual Spatial and Channel Attention Networks for Single Image Dehazing Jiang, Xin Zhao, Chunlei Zhu, Ming Hao, Zhicheng Gao, Wen Sensors (Basel) Article Single image dehazing is a highly challenging ill-posed problem. Existing methods including both prior-based and learning-based heavily rely on the conceptual simplified atmospheric scattering model by estimating the so-called medium transmission map and atmospheric light. However, the formation of haze in the real world is much more complicated and inaccurate estimations further degrade the dehazing performance with color distortion, artifacts and insufficient haze removal. Moreover, most dehazing networks treat spatial-wise and channel-wise features equally, but haze is practically unevenly distributed across an image, thus regions with different haze concentrations require different attentions. To solve these problems, we propose an end-to-end trainable densely connected residual spatial and channel attention network based on the conditional generative adversarial framework to directly restore a haze-free image from an input hazy image, without explicitly estimation of any atmospheric scattering parameters. Specifically, a novel residual attention module is proposed by combining spatial attention and channel attention mechanism, which could adaptively recalibrate spatial-wise and channel-wise feature weights by considering interdependencies among spatial and channel information. Such a mechanism allows the network to concentrate on more useful pixels and channels. Meanwhile, the dense network can maximize the information flow along features from different levels to encourage feature reuse and strengthen feature propagation. In addition, the network is trained with a multi-loss function, in which contrastive loss and registration loss are novel refined to restore sharper structures and ensure better visual quality. Experimental results demonstrate that the proposed method achieves the state-of-the-art performance on both public synthetic datasets and real-world images with more visually pleasing dehazed results. MDPI 2021-11-27 /pmc/articles/PMC8659565/ /pubmed/34883928 http://dx.doi.org/10.3390/s21237922 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Jiang, Xin
Zhao, Chunlei
Zhu, Ming
Hao, Zhicheng
Gao, Wen
Residual Spatial and Channel Attention Networks for Single Image Dehazing
title Residual Spatial and Channel Attention Networks for Single Image Dehazing
title_full Residual Spatial and Channel Attention Networks for Single Image Dehazing
title_fullStr Residual Spatial and Channel Attention Networks for Single Image Dehazing
title_full_unstemmed Residual Spatial and Channel Attention Networks for Single Image Dehazing
title_short Residual Spatial and Channel Attention Networks for Single Image Dehazing
title_sort residual spatial and channel attention networks for single image dehazing
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8659565/
https://www.ncbi.nlm.nih.gov/pubmed/34883928
http://dx.doi.org/10.3390/s21237922
work_keys_str_mv AT jiangxin residualspatialandchannelattentionnetworksforsingleimagedehazing
AT zhaochunlei residualspatialandchannelattentionnetworksforsingleimagedehazing
AT zhuming residualspatialandchannelattentionnetworksforsingleimagedehazing
AT haozhicheng residualspatialandchannelattentionnetworksforsingleimagedehazing
AT gaowen residualspatialandchannelattentionnetworksforsingleimagedehazing