Cargando…
A Lightweight Fusion Distillation Network for Image Deblurring and Deraining †
Recently, deep learning-based image deblurring and deraining have been well developed. However, most of these methods fail to distill the useful features. What is more, exploiting the detailed image features in a deep learning framework always requires a mass of parameters, which inevitably makes th...
Autores principales: | , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8398398/ https://www.ncbi.nlm.nih.gov/pubmed/34450762 http://dx.doi.org/10.3390/s21165312 |
_version_ | 1783744830134812672 |
---|---|
author | Zhang, Yanni Liu, Yiming Li, Qiang Wang, Jianzhong Qi, Miao Sun, Hui Xu, Hui Kong, Jun |
author_facet | Zhang, Yanni Liu, Yiming Li, Qiang Wang, Jianzhong Qi, Miao Sun, Hui Xu, Hui Kong, Jun |
author_sort | Zhang, Yanni |
collection | PubMed |
description | Recently, deep learning-based image deblurring and deraining have been well developed. However, most of these methods fail to distill the useful features. What is more, exploiting the detailed image features in a deep learning framework always requires a mass of parameters, which inevitably makes the network suffer from a high computational burden. We propose a lightweight fusion distillation network (LFDN) for image deblurring and deraining to solve the above problems. The proposed LFDN is designed as an encoder–decoder architecture. In the encoding stage, the image feature is reduced to various small-scale spaces for multi-scale information extraction and fusion without much information loss. Then, a feature distillation normalization block is designed at the beginning of the decoding stage, which enables the network to distill and screen valuable channel information of feature maps continuously. Besides, an information fusion strategy between distillation modules and feature channels is also carried out by the attention mechanism. By fusing different information in the proposed approach, our network can achieve state-of-the-art image deblurring and deraining results with a smaller number of parameters and outperform the existing methods in model complexity. |
format | Online Article Text |
id | pubmed-8398398 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-83983982021-08-29 A Lightweight Fusion Distillation Network for Image Deblurring and Deraining † Zhang, Yanni Liu, Yiming Li, Qiang Wang, Jianzhong Qi, Miao Sun, Hui Xu, Hui Kong, Jun Sensors (Basel) Article Recently, deep learning-based image deblurring and deraining have been well developed. However, most of these methods fail to distill the useful features. What is more, exploiting the detailed image features in a deep learning framework always requires a mass of parameters, which inevitably makes the network suffer from a high computational burden. We propose a lightweight fusion distillation network (LFDN) for image deblurring and deraining to solve the above problems. The proposed LFDN is designed as an encoder–decoder architecture. In the encoding stage, the image feature is reduced to various small-scale spaces for multi-scale information extraction and fusion without much information loss. Then, a feature distillation normalization block is designed at the beginning of the decoding stage, which enables the network to distill and screen valuable channel information of feature maps continuously. Besides, an information fusion strategy between distillation modules and feature channels is also carried out by the attention mechanism. By fusing different information in the proposed approach, our network can achieve state-of-the-art image deblurring and deraining results with a smaller number of parameters and outperform the existing methods in model complexity. MDPI 2021-08-06 /pmc/articles/PMC8398398/ /pubmed/34450762 http://dx.doi.org/10.3390/s21165312 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Zhang, Yanni Liu, Yiming Li, Qiang Wang, Jianzhong Qi, Miao Sun, Hui Xu, Hui Kong, Jun A Lightweight Fusion Distillation Network for Image Deblurring and Deraining † |
title | A Lightweight Fusion Distillation Network for Image Deblurring and Deraining † |
title_full | A Lightweight Fusion Distillation Network for Image Deblurring and Deraining † |
title_fullStr | A Lightweight Fusion Distillation Network for Image Deblurring and Deraining † |
title_full_unstemmed | A Lightweight Fusion Distillation Network for Image Deblurring and Deraining † |
title_short | A Lightweight Fusion Distillation Network for Image Deblurring and Deraining † |
title_sort | lightweight fusion distillation network for image deblurring and deraining † |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8398398/ https://www.ncbi.nlm.nih.gov/pubmed/34450762 http://dx.doi.org/10.3390/s21165312 |
work_keys_str_mv | AT zhangyanni alightweightfusiondistillationnetworkforimagedeblurringandderaining AT liuyiming alightweightfusiondistillationnetworkforimagedeblurringandderaining AT liqiang alightweightfusiondistillationnetworkforimagedeblurringandderaining AT wangjianzhong alightweightfusiondistillationnetworkforimagedeblurringandderaining AT qimiao alightweightfusiondistillationnetworkforimagedeblurringandderaining AT sunhui alightweightfusiondistillationnetworkforimagedeblurringandderaining AT xuhui alightweightfusiondistillationnetworkforimagedeblurringandderaining AT kongjun alightweightfusiondistillationnetworkforimagedeblurringandderaining AT zhangyanni lightweightfusiondistillationnetworkforimagedeblurringandderaining AT liuyiming lightweightfusiondistillationnetworkforimagedeblurringandderaining AT liqiang lightweightfusiondistillationnetworkforimagedeblurringandderaining AT wangjianzhong lightweightfusiondistillationnetworkforimagedeblurringandderaining AT qimiao lightweightfusiondistillationnetworkforimagedeblurringandderaining AT sunhui lightweightfusiondistillationnetworkforimagedeblurringandderaining AT xuhui lightweightfusiondistillationnetworkforimagedeblurringandderaining AT kongjun lightweightfusiondistillationnetworkforimagedeblurringandderaining |