Cargando…

An Efficient Dehazing Algorithm Based on the Fusion of Transformer and Convolutional Neural Network

The purpose of image dehazing is to remove the interference from weather factors in degraded images and enhance the clarity and color saturation of images to maximize the restoration of useful features. Single image dehazing is one of the most important tasks in the field of image restoration. In re...

Descripción completa

Detalles Bibliográficos
Autores principales: Xu, Jun, Chen, Zi-Xuan, Luo, Hao, Lu, Zhe-Ming
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9823512/
https://www.ncbi.nlm.nih.gov/pubmed/36616639
http://dx.doi.org/10.3390/s23010043
_version_ 1784866177949892608
author Xu, Jun
Chen, Zi-Xuan
Luo, Hao
Lu, Zhe-Ming
author_facet Xu, Jun
Chen, Zi-Xuan
Luo, Hao
Lu, Zhe-Ming
author_sort Xu, Jun
collection PubMed
description The purpose of image dehazing is to remove the interference from weather factors in degraded images and enhance the clarity and color saturation of images to maximize the restoration of useful features. Single image dehazing is one of the most important tasks in the field of image restoration. In recent years, due to the progress of deep learning, single image dehazing has made great progress. With the success of Transformer in advanced computer vision tasks, some research studies also began to apply Transformer to image dehazing tasks and obtained surprising results. However, both the deconvolution-neural-network-based dehazing algorithm and Transformer based dehazing algorithm magnify their advantages and disadvantages separately. Therefore, this paper proposes a novel Transformer–Convolution fusion dehazing network (TCFDN), which uses Transformer’s global modeling ability and convolutional neural network’s local modeling ability to improve the dehazing ability. In the Transformer–Convolution fusion dehazing network, the classic self-encoder structure is used. This paper proposes a Transformer–Convolution hybrid layer, which uses an adaptive fusion strategy to make full use of the Swin-Transformer and convolutional neural network to extract and reconstruct image features. On the basis of previous research, this layer further improves the ability of the network to remove haze. A series of contrast experiments and ablation experiments not only proved that the Transformer–Convolution fusion dehazing network proposed in this paper exceeded the more advanced dehazing algorithm, but also provided solid and powerful evidence for the basic theory on which it depends.
format Online
Article
Text
id pubmed-9823512
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-98235122023-01-08 An Efficient Dehazing Algorithm Based on the Fusion of Transformer and Convolutional Neural Network Xu, Jun Chen, Zi-Xuan Luo, Hao Lu, Zhe-Ming Sensors (Basel) Article The purpose of image dehazing is to remove the interference from weather factors in degraded images and enhance the clarity and color saturation of images to maximize the restoration of useful features. Single image dehazing is one of the most important tasks in the field of image restoration. In recent years, due to the progress of deep learning, single image dehazing has made great progress. With the success of Transformer in advanced computer vision tasks, some research studies also began to apply Transformer to image dehazing tasks and obtained surprising results. However, both the deconvolution-neural-network-based dehazing algorithm and Transformer based dehazing algorithm magnify their advantages and disadvantages separately. Therefore, this paper proposes a novel Transformer–Convolution fusion dehazing network (TCFDN), which uses Transformer’s global modeling ability and convolutional neural network’s local modeling ability to improve the dehazing ability. In the Transformer–Convolution fusion dehazing network, the classic self-encoder structure is used. This paper proposes a Transformer–Convolution hybrid layer, which uses an adaptive fusion strategy to make full use of the Swin-Transformer and convolutional neural network to extract and reconstruct image features. On the basis of previous research, this layer further improves the ability of the network to remove haze. A series of contrast experiments and ablation experiments not only proved that the Transformer–Convolution fusion dehazing network proposed in this paper exceeded the more advanced dehazing algorithm, but also provided solid and powerful evidence for the basic theory on which it depends. MDPI 2022-12-21 /pmc/articles/PMC9823512/ /pubmed/36616639 http://dx.doi.org/10.3390/s23010043 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Xu, Jun
Chen, Zi-Xuan
Luo, Hao
Lu, Zhe-Ming
An Efficient Dehazing Algorithm Based on the Fusion of Transformer and Convolutional Neural Network
title An Efficient Dehazing Algorithm Based on the Fusion of Transformer and Convolutional Neural Network
title_full An Efficient Dehazing Algorithm Based on the Fusion of Transformer and Convolutional Neural Network
title_fullStr An Efficient Dehazing Algorithm Based on the Fusion of Transformer and Convolutional Neural Network
title_full_unstemmed An Efficient Dehazing Algorithm Based on the Fusion of Transformer and Convolutional Neural Network
title_short An Efficient Dehazing Algorithm Based on the Fusion of Transformer and Convolutional Neural Network
title_sort efficient dehazing algorithm based on the fusion of transformer and convolutional neural network
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9823512/
https://www.ncbi.nlm.nih.gov/pubmed/36616639
http://dx.doi.org/10.3390/s23010043
work_keys_str_mv AT xujun anefficientdehazingalgorithmbasedonthefusionoftransformerandconvolutionalneuralnetwork
AT chenzixuan anefficientdehazingalgorithmbasedonthefusionoftransformerandconvolutionalneuralnetwork
AT luohao anefficientdehazingalgorithmbasedonthefusionoftransformerandconvolutionalneuralnetwork
AT luzheming anefficientdehazingalgorithmbasedonthefusionoftransformerandconvolutionalneuralnetwork
AT xujun efficientdehazingalgorithmbasedonthefusionoftransformerandconvolutionalneuralnetwork
AT chenzixuan efficientdehazingalgorithmbasedonthefusionoftransformerandconvolutionalneuralnetwork
AT luohao efficientdehazingalgorithmbasedonthefusionoftransformerandconvolutionalneuralnetwork
AT luzheming efficientdehazingalgorithmbasedonthefusionoftransformerandconvolutionalneuralnetwork