Cargando…

A Novel Residual Dense Pyramid Network for Image Dehazing

Recently, convolutional neural network (CNN) based on the encoder-decoder structure have been successfully applied to image dehazing. However, these CNN based dehazing methods have two limitations: First, these dehazing models are large in size with enormous parameters, which not only consumes much...

Descripción completa

Detalles Bibliográficos
Autores principales: Yin, Shibai, Wang, Yibin, Yang, Yee-Hong
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2019
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7514467/
http://dx.doi.org/10.3390/e21111123
_version_ 1783586594968567808
author Yin, Shibai
Wang, Yibin
Yang, Yee-Hong
author_facet Yin, Shibai
Wang, Yibin
Yang, Yee-Hong
author_sort Yin, Shibai
collection PubMed
description Recently, convolutional neural network (CNN) based on the encoder-decoder structure have been successfully applied to image dehazing. However, these CNN based dehazing methods have two limitations: First, these dehazing models are large in size with enormous parameters, which not only consumes much GPU memory, but also is hard to train from scratch. Second, these models, which ignore the structural information at different resolutions of intermediate layers, cannot capture informative texture and edge information for dehazing by stacking more layers. In this paper, we propose a light-weight end-to-end network named the residual dense pyramid network (RDPN) to address the above problems. To exploit the structural information at different resolutions of intermediate layers fully, a new residual dense pyramid (RDP) is proposed as a building block. By introducing a dense information fusion layer and the residual learning module, the RDP can maximize the information flow and extract local features. Furthermore, the RDP further learns the structural information from intermediate layers via a multiscale pyramid fusion mechanism. To reduce the number of network parameters and to ease the training process, we use one RDP in the encoder and two RDPs in the decoder, following a multilevel pyramid pooling layer for incorporating global context features before estimating the final result. The extensive experimental results on a synthetic dataset and real-world images demonstrate that the new RDPN achieves favourable performance compared with some state-of-the-art methods, e.g., the recent densely connected pyramid dehazing network, the all-in-one dehazing network, the enhanced pix2pix dehazing network, pixel-based alpha blending, artificial multi-exposure image fusions and the genetic programming estimator, in terms of accuracy, run time and number of parameters. To be specific, RDPN outperforms all of the above methods in terms of PSNR by at least 4.25 dB. The run time of the proposed method is 0.021 s, and the number of parameters is 1,534,799, only 6% of that used by the densely connected pyramid dehazing network.
format Online
Article
Text
id pubmed-7514467
institution National Center for Biotechnology Information
language English
publishDate 2019
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-75144672020-11-09 A Novel Residual Dense Pyramid Network for Image Dehazing Yin, Shibai Wang, Yibin Yang, Yee-Hong Entropy (Basel) Article Recently, convolutional neural network (CNN) based on the encoder-decoder structure have been successfully applied to image dehazing. However, these CNN based dehazing methods have two limitations: First, these dehazing models are large in size with enormous parameters, which not only consumes much GPU memory, but also is hard to train from scratch. Second, these models, which ignore the structural information at different resolutions of intermediate layers, cannot capture informative texture and edge information for dehazing by stacking more layers. In this paper, we propose a light-weight end-to-end network named the residual dense pyramid network (RDPN) to address the above problems. To exploit the structural information at different resolutions of intermediate layers fully, a new residual dense pyramid (RDP) is proposed as a building block. By introducing a dense information fusion layer and the residual learning module, the RDP can maximize the information flow and extract local features. Furthermore, the RDP further learns the structural information from intermediate layers via a multiscale pyramid fusion mechanism. To reduce the number of network parameters and to ease the training process, we use one RDP in the encoder and two RDPs in the decoder, following a multilevel pyramid pooling layer for incorporating global context features before estimating the final result. The extensive experimental results on a synthetic dataset and real-world images demonstrate that the new RDPN achieves favourable performance compared with some state-of-the-art methods, e.g., the recent densely connected pyramid dehazing network, the all-in-one dehazing network, the enhanced pix2pix dehazing network, pixel-based alpha blending, artificial multi-exposure image fusions and the genetic programming estimator, in terms of accuracy, run time and number of parameters. To be specific, RDPN outperforms all of the above methods in terms of PSNR by at least 4.25 dB. The run time of the proposed method is 0.021 s, and the number of parameters is 1,534,799, only 6% of that used by the densely connected pyramid dehazing network. MDPI 2019-11-15 /pmc/articles/PMC7514467/ http://dx.doi.org/10.3390/e21111123 Text en © 2019 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Yin, Shibai
Wang, Yibin
Yang, Yee-Hong
A Novel Residual Dense Pyramid Network for Image Dehazing
title A Novel Residual Dense Pyramid Network for Image Dehazing
title_full A Novel Residual Dense Pyramid Network for Image Dehazing
title_fullStr A Novel Residual Dense Pyramid Network for Image Dehazing
title_full_unstemmed A Novel Residual Dense Pyramid Network for Image Dehazing
title_short A Novel Residual Dense Pyramid Network for Image Dehazing
title_sort novel residual dense pyramid network for image dehazing
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7514467/
http://dx.doi.org/10.3390/e21111123
work_keys_str_mv AT yinshibai anovelresidualdensepyramidnetworkforimagedehazing
AT wangyibin anovelresidualdensepyramidnetworkforimagedehazing
AT yangyeehong anovelresidualdensepyramidnetworkforimagedehazing
AT yinshibai novelresidualdensepyramidnetworkforimagedehazing
AT wangyibin novelresidualdensepyramidnetworkforimagedehazing
AT yangyeehong novelresidualdensepyramidnetworkforimagedehazing