Cargando…
Combining Motion Compensation with Spatiotemporal Constraint for Video Deblurring
We propose a video deblurring method by combining motion compensation with spatiotemporal constraint for restoring blurry video caused by camera shake. The proposed method makes effective full use of the spatiotemporal information not only in the blur kernel estimation, but also in the latent sharp...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2018
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6022012/ https://www.ncbi.nlm.nih.gov/pubmed/29865162 http://dx.doi.org/10.3390/s18061774 |
_version_ | 1783335584742244352 |
---|---|
author | Li, Jing Gong, Weiguo Li, Weihong |
author_facet | Li, Jing Gong, Weiguo Li, Weihong |
author_sort | Li, Jing |
collection | PubMed |
description | We propose a video deblurring method by combining motion compensation with spatiotemporal constraint for restoring blurry video caused by camera shake. The proposed method makes effective full use of the spatiotemporal information not only in the blur kernel estimation, but also in the latent sharp frame restoration. Firstly, we estimate a motion vector between the current and the previous blurred frames, and introduce the estimated motion vector for deriving the motion-compensated frame with the previous restored frame. Secondly, we proposed a blur kernel estimation strategy by applying the derived motion-compensated frame to an improved regularization model for improving the quality of the estimated blur kernel and reducing the processing time. Thirdly, we propose a spatiotemporal constraint algorithm that can not only enhance temporal consistency, but also suppress noise and ringing artifacts of the deblurred video through introducing a temporal regularization term. Finally, we extend Fast Total Variation de-convolution (FTVd) for solving the minimization problem of the proposed spatiotemporal constraint energy function. Extensive experiments demonstrate that the proposed method achieve the state-of-the-art results either in subjective vision or objective evaluation. |
format | Online Article Text |
id | pubmed-6022012 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2018 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-60220122018-07-02 Combining Motion Compensation with Spatiotemporal Constraint for Video Deblurring Li, Jing Gong, Weiguo Li, Weihong Sensors (Basel) Article We propose a video deblurring method by combining motion compensation with spatiotemporal constraint for restoring blurry video caused by camera shake. The proposed method makes effective full use of the spatiotemporal information not only in the blur kernel estimation, but also in the latent sharp frame restoration. Firstly, we estimate a motion vector between the current and the previous blurred frames, and introduce the estimated motion vector for deriving the motion-compensated frame with the previous restored frame. Secondly, we proposed a blur kernel estimation strategy by applying the derived motion-compensated frame to an improved regularization model for improving the quality of the estimated blur kernel and reducing the processing time. Thirdly, we propose a spatiotemporal constraint algorithm that can not only enhance temporal consistency, but also suppress noise and ringing artifacts of the deblurred video through introducing a temporal regularization term. Finally, we extend Fast Total Variation de-convolution (FTVd) for solving the minimization problem of the proposed spatiotemporal constraint energy function. Extensive experiments demonstrate that the proposed method achieve the state-of-the-art results either in subjective vision or objective evaluation. MDPI 2018-06-01 /pmc/articles/PMC6022012/ /pubmed/29865162 http://dx.doi.org/10.3390/s18061774 Text en © 2018 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Li, Jing Gong, Weiguo Li, Weihong Combining Motion Compensation with Spatiotemporal Constraint for Video Deblurring |
title | Combining Motion Compensation with Spatiotemporal Constraint for Video Deblurring |
title_full | Combining Motion Compensation with Spatiotemporal Constraint for Video Deblurring |
title_fullStr | Combining Motion Compensation with Spatiotemporal Constraint for Video Deblurring |
title_full_unstemmed | Combining Motion Compensation with Spatiotemporal Constraint for Video Deblurring |
title_short | Combining Motion Compensation with Spatiotemporal Constraint for Video Deblurring |
title_sort | combining motion compensation with spatiotemporal constraint for video deblurring |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6022012/ https://www.ncbi.nlm.nih.gov/pubmed/29865162 http://dx.doi.org/10.3390/s18061774 |
work_keys_str_mv | AT lijing combiningmotioncompensationwithspatiotemporalconstraintforvideodeblurring AT gongweiguo combiningmotioncompensationwithspatiotemporalconstraintforvideodeblurring AT liweihong combiningmotioncompensationwithspatiotemporalconstraintforvideodeblurring |