Cargando…

A Lightweight Fusion Distillation Network for Image Deblurring and Deraining †

Recently, deep learning-based image deblurring and deraining have been well developed. However, most of these methods fail to distill the useful features. What is more, exploiting the detailed image features in a deep learning framework always requires a mass of parameters, which inevitably makes th...

Descripción completa

Detalles Bibliográficos
Autores principales: Zhang, Yanni, Liu, Yiming, Li, Qiang, Wang, Jianzhong, Qi, Miao, Sun, Hui, Xu, Hui, Kong, Jun
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8398398/
https://www.ncbi.nlm.nih.gov/pubmed/34450762
http://dx.doi.org/10.3390/s21165312
_version_ 1783744830134812672
author Zhang, Yanni
Liu, Yiming
Li, Qiang
Wang, Jianzhong
Qi, Miao
Sun, Hui
Xu, Hui
Kong, Jun
author_facet Zhang, Yanni
Liu, Yiming
Li, Qiang
Wang, Jianzhong
Qi, Miao
Sun, Hui
Xu, Hui
Kong, Jun
author_sort Zhang, Yanni
collection PubMed
description Recently, deep learning-based image deblurring and deraining have been well developed. However, most of these methods fail to distill the useful features. What is more, exploiting the detailed image features in a deep learning framework always requires a mass of parameters, which inevitably makes the network suffer from a high computational burden. We propose a lightweight fusion distillation network (LFDN) for image deblurring and deraining to solve the above problems. The proposed LFDN is designed as an encoder–decoder architecture. In the encoding stage, the image feature is reduced to various small-scale spaces for multi-scale information extraction and fusion without much information loss. Then, a feature distillation normalization block is designed at the beginning of the decoding stage, which enables the network to distill and screen valuable channel information of feature maps continuously. Besides, an information fusion strategy between distillation modules and feature channels is also carried out by the attention mechanism. By fusing different information in the proposed approach, our network can achieve state-of-the-art image deblurring and deraining results with a smaller number of parameters and outperform the existing methods in model complexity.
format Online
Article
Text
id pubmed-8398398
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-83983982021-08-29 A Lightweight Fusion Distillation Network for Image Deblurring and Deraining † Zhang, Yanni Liu, Yiming Li, Qiang Wang, Jianzhong Qi, Miao Sun, Hui Xu, Hui Kong, Jun Sensors (Basel) Article Recently, deep learning-based image deblurring and deraining have been well developed. However, most of these methods fail to distill the useful features. What is more, exploiting the detailed image features in a deep learning framework always requires a mass of parameters, which inevitably makes the network suffer from a high computational burden. We propose a lightweight fusion distillation network (LFDN) for image deblurring and deraining to solve the above problems. The proposed LFDN is designed as an encoder–decoder architecture. In the encoding stage, the image feature is reduced to various small-scale spaces for multi-scale information extraction and fusion without much information loss. Then, a feature distillation normalization block is designed at the beginning of the decoding stage, which enables the network to distill and screen valuable channel information of feature maps continuously. Besides, an information fusion strategy between distillation modules and feature channels is also carried out by the attention mechanism. By fusing different information in the proposed approach, our network can achieve state-of-the-art image deblurring and deraining results with a smaller number of parameters and outperform the existing methods in model complexity. MDPI 2021-08-06 /pmc/articles/PMC8398398/ /pubmed/34450762 http://dx.doi.org/10.3390/s21165312 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Zhang, Yanni
Liu, Yiming
Li, Qiang
Wang, Jianzhong
Qi, Miao
Sun, Hui
Xu, Hui
Kong, Jun
A Lightweight Fusion Distillation Network for Image Deblurring and Deraining †
title A Lightweight Fusion Distillation Network for Image Deblurring and Deraining †
title_full A Lightweight Fusion Distillation Network for Image Deblurring and Deraining †
title_fullStr A Lightweight Fusion Distillation Network for Image Deblurring and Deraining †
title_full_unstemmed A Lightweight Fusion Distillation Network for Image Deblurring and Deraining †
title_short A Lightweight Fusion Distillation Network for Image Deblurring and Deraining †
title_sort lightweight fusion distillation network for image deblurring and deraining †
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8398398/
https://www.ncbi.nlm.nih.gov/pubmed/34450762
http://dx.doi.org/10.3390/s21165312
work_keys_str_mv AT zhangyanni alightweightfusiondistillationnetworkforimagedeblurringandderaining
AT liuyiming alightweightfusiondistillationnetworkforimagedeblurringandderaining
AT liqiang alightweightfusiondistillationnetworkforimagedeblurringandderaining
AT wangjianzhong alightweightfusiondistillationnetworkforimagedeblurringandderaining
AT qimiao alightweightfusiondistillationnetworkforimagedeblurringandderaining
AT sunhui alightweightfusiondistillationnetworkforimagedeblurringandderaining
AT xuhui alightweightfusiondistillationnetworkforimagedeblurringandderaining
AT kongjun alightweightfusiondistillationnetworkforimagedeblurringandderaining
AT zhangyanni lightweightfusiondistillationnetworkforimagedeblurringandderaining
AT liuyiming lightweightfusiondistillationnetworkforimagedeblurringandderaining
AT liqiang lightweightfusiondistillationnetworkforimagedeblurringandderaining
AT wangjianzhong lightweightfusiondistillationnetworkforimagedeblurringandderaining
AT qimiao lightweightfusiondistillationnetworkforimagedeblurringandderaining
AT sunhui lightweightfusiondistillationnetworkforimagedeblurringandderaining
AT xuhui lightweightfusiondistillationnetworkforimagedeblurringandderaining
AT kongjun lightweightfusiondistillationnetworkforimagedeblurringandderaining