Cargando…

Frequency Disentanglement Distillation Image Deblurring Network

Due to the blur information and content information entanglement in the blind deblurring task, it is very challenging to directly recover the sharp latent image from the blurred image. Considering that in the high-dimensional feature map, blur information mainly exists in the low-frequency region, a...

Descripción completa

Detalles Bibliográficos
Autores principales: Liu, Yiming, Guo, Jianping, Yang, Sen, Liu, Ting, Zhou, Hualing, Liang, Mengzi, Li, Xi, Xu, Dahong
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8309585/
https://www.ncbi.nlm.nih.gov/pubmed/34300444
http://dx.doi.org/10.3390/s21144702
_version_ 1783728556439764992
author Liu, Yiming
Guo, Jianping
Yang, Sen
Liu, Ting
Zhou, Hualing
Liang, Mengzi
Li, Xi
Xu, Dahong
author_facet Liu, Yiming
Guo, Jianping
Yang, Sen
Liu, Ting
Zhou, Hualing
Liang, Mengzi
Li, Xi
Xu, Dahong
author_sort Liu, Yiming
collection PubMed
description Due to the blur information and content information entanglement in the blind deblurring task, it is very challenging to directly recover the sharp latent image from the blurred image. Considering that in the high-dimensional feature map, blur information mainly exists in the low-frequency region, and content information exists in the high-frequency region. In this paper, we propose a encoder–decoder model to realize disentanglement from the perspective of frequency, and we named it as frequency disentanglement distillation image deblurring network (FDDN). First, we modified the traditional distillation block by embedding the frequency split block (FSB) in the distillation block to separate the low-frequency and high-frequency region. Second, the modified distillation block, we named frequency distillation block (FDB), can recursively distill the low-frequency feature to disentangle the blurry information from the content information, so as to improve the restored image quality. Furthermore, to reduce the complexity of the network and ensure the high-dimension of the feature map, the frequency distillation block (FDB) is placed on the end of encoder to edit the feature map on the latent space. Quantitative and qualitative experimental evaluations indicate that the FDDN can remove the blur effect and improve the image quality of actual and simulated images.
format Online
Article
Text
id pubmed-8309585
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-83095852021-07-25 Frequency Disentanglement Distillation Image Deblurring Network Liu, Yiming Guo, Jianping Yang, Sen Liu, Ting Zhou, Hualing Liang, Mengzi Li, Xi Xu, Dahong Sensors (Basel) Article Due to the blur information and content information entanglement in the blind deblurring task, it is very challenging to directly recover the sharp latent image from the blurred image. Considering that in the high-dimensional feature map, blur information mainly exists in the low-frequency region, and content information exists in the high-frequency region. In this paper, we propose a encoder–decoder model to realize disentanglement from the perspective of frequency, and we named it as frequency disentanglement distillation image deblurring network (FDDN). First, we modified the traditional distillation block by embedding the frequency split block (FSB) in the distillation block to separate the low-frequency and high-frequency region. Second, the modified distillation block, we named frequency distillation block (FDB), can recursively distill the low-frequency feature to disentangle the blurry information from the content information, so as to improve the restored image quality. Furthermore, to reduce the complexity of the network and ensure the high-dimension of the feature map, the frequency distillation block (FDB) is placed on the end of encoder to edit the feature map on the latent space. Quantitative and qualitative experimental evaluations indicate that the FDDN can remove the blur effect and improve the image quality of actual and simulated images. MDPI 2021-07-09 /pmc/articles/PMC8309585/ /pubmed/34300444 http://dx.doi.org/10.3390/s21144702 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Liu, Yiming
Guo, Jianping
Yang, Sen
Liu, Ting
Zhou, Hualing
Liang, Mengzi
Li, Xi
Xu, Dahong
Frequency Disentanglement Distillation Image Deblurring Network
title Frequency Disentanglement Distillation Image Deblurring Network
title_full Frequency Disentanglement Distillation Image Deblurring Network
title_fullStr Frequency Disentanglement Distillation Image Deblurring Network
title_full_unstemmed Frequency Disentanglement Distillation Image Deblurring Network
title_short Frequency Disentanglement Distillation Image Deblurring Network
title_sort frequency disentanglement distillation image deblurring network
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8309585/
https://www.ncbi.nlm.nih.gov/pubmed/34300444
http://dx.doi.org/10.3390/s21144702
work_keys_str_mv AT liuyiming frequencydisentanglementdistillationimagedeblurringnetwork
AT guojianping frequencydisentanglementdistillationimagedeblurringnetwork
AT yangsen frequencydisentanglementdistillationimagedeblurringnetwork
AT liuting frequencydisentanglementdistillationimagedeblurringnetwork
AT zhouhualing frequencydisentanglementdistillationimagedeblurringnetwork
AT liangmengzi frequencydisentanglementdistillationimagedeblurringnetwork
AT lixi frequencydisentanglementdistillationimagedeblurringnetwork
AT xudahong frequencydisentanglementdistillationimagedeblurringnetwork