Cargando…

A Hybrid Motion Estimation for Video Stabilization Based on an IMU Sensor

Recorded video data must be clear for accuracy and faster analysis during post-processing, which often requires video stabilization systems to remove undesired motion. In this paper, we proposed a hybrid method to estimate the motion and to stabilize videos by the switching function. This method swi...

Descripción completa

Detalles Bibliográficos
Autores principales: Auysakul, Jutamanee, Xu, He, Pooneeth, Vishwanath
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2018
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6111248/
https://www.ncbi.nlm.nih.gov/pubmed/30126143
http://dx.doi.org/10.3390/s18082708
_version_ 1783350616706252800
author Auysakul, Jutamanee
Xu, He
Pooneeth, Vishwanath
author_facet Auysakul, Jutamanee
Xu, He
Pooneeth, Vishwanath
author_sort Auysakul, Jutamanee
collection PubMed
description Recorded video data must be clear for accuracy and faster analysis during post-processing, which often requires video stabilization systems to remove undesired motion. In this paper, we proposed a hybrid method to estimate the motion and to stabilize videos by the switching function. This method switched the estimated motion between a Kanade–Lucus–Tomasi (KLT) tracker and an IMU-aided motion estimator. It facilitated the best function to stabilize the video in real-time as those methods had numerous advantages in estimating the motion. To achieve this, we used a KLT tracker to correct the motion for low rotations and an IMU-aided motion estimator for high rotation, owing to the poor performance of the KLT tracker during larger movements. Furthermore, a Kalman filter was used to remove the undesired motion and hence smoothen the trajectory. To increase the frame rate, a multi-threaded approach was applied to execute the algorithm in the array. Irrespective of the situations exposed to the experimental results of the moving camera from five video sequences revealed that the proposed algorithm stabilized the video efficiently.
format Online
Article
Text
id pubmed-6111248
institution National Center for Biotechnology Information
language English
publishDate 2018
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-61112482018-08-30 A Hybrid Motion Estimation for Video Stabilization Based on an IMU Sensor Auysakul, Jutamanee Xu, He Pooneeth, Vishwanath Sensors (Basel) Article Recorded video data must be clear for accuracy and faster analysis during post-processing, which often requires video stabilization systems to remove undesired motion. In this paper, we proposed a hybrid method to estimate the motion and to stabilize videos by the switching function. This method switched the estimated motion between a Kanade–Lucus–Tomasi (KLT) tracker and an IMU-aided motion estimator. It facilitated the best function to stabilize the video in real-time as those methods had numerous advantages in estimating the motion. To achieve this, we used a KLT tracker to correct the motion for low rotations and an IMU-aided motion estimator for high rotation, owing to the poor performance of the KLT tracker during larger movements. Furthermore, a Kalman filter was used to remove the undesired motion and hence smoothen the trajectory. To increase the frame rate, a multi-threaded approach was applied to execute the algorithm in the array. Irrespective of the situations exposed to the experimental results of the moving camera from five video sequences revealed that the proposed algorithm stabilized the video efficiently. MDPI 2018-08-17 /pmc/articles/PMC6111248/ /pubmed/30126143 http://dx.doi.org/10.3390/s18082708 Text en © 2018 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Auysakul, Jutamanee
Xu, He
Pooneeth, Vishwanath
A Hybrid Motion Estimation for Video Stabilization Based on an IMU Sensor
title A Hybrid Motion Estimation for Video Stabilization Based on an IMU Sensor
title_full A Hybrid Motion Estimation for Video Stabilization Based on an IMU Sensor
title_fullStr A Hybrid Motion Estimation for Video Stabilization Based on an IMU Sensor
title_full_unstemmed A Hybrid Motion Estimation for Video Stabilization Based on an IMU Sensor
title_short A Hybrid Motion Estimation for Video Stabilization Based on an IMU Sensor
title_sort hybrid motion estimation for video stabilization based on an imu sensor
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6111248/
https://www.ncbi.nlm.nih.gov/pubmed/30126143
http://dx.doi.org/10.3390/s18082708
work_keys_str_mv AT auysakuljutamanee ahybridmotionestimationforvideostabilizationbasedonanimusensor
AT xuhe ahybridmotionestimationforvideostabilizationbasedonanimusensor
AT pooneethvishwanath ahybridmotionestimationforvideostabilizationbasedonanimusensor
AT auysakuljutamanee hybridmotionestimationforvideostabilizationbasedonanimusensor
AT xuhe hybridmotionestimationforvideostabilizationbasedonanimusensor
AT pooneethvishwanath hybridmotionestimationforvideostabilizationbasedonanimusensor