Cargando…

Robust Global Motion Estimation for Video Stabilization Based on Improved K-Means Clustering and Superpixel

Obtaining accurate global motion is a crucial step for video stabilization. This paper proposes a robust and simple method to implement global motion estimation. We don’t extend the framework of 2D video stabilization but add a “plug and play” module to motion estimation based on feature points. Fir...

Descripción completa

Detalles Bibliográficos
Autores principales: Wu, Rouwan, Xu, Zhiyong, Zhang, Jianlin, Zhang, Lihong
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8038417/
https://www.ncbi.nlm.nih.gov/pubmed/33916773
http://dx.doi.org/10.3390/s21072505
_version_ 1783677370757021696
author Wu, Rouwan
Xu, Zhiyong
Zhang, Jianlin
Zhang, Lihong
author_facet Wu, Rouwan
Xu, Zhiyong
Zhang, Jianlin
Zhang, Lihong
author_sort Wu, Rouwan
collection PubMed
description Obtaining accurate global motion is a crucial step for video stabilization. This paper proposes a robust and simple method to implement global motion estimation. We don’t extend the framework of 2D video stabilization but add a “plug and play” module to motion estimation based on feature points. Firstly, simple linear iterative clustering (SLIC) pre-segmentation is used to obtain superpixels of the video frame, clustering is performed according to the superpixel centroid motion vector and cluster center with large value is eliminated. Secondly, in order to obtain accurate global motion estimation, an improved K-means clustering is proposed. We match the feature points of the remaining superpixels between two adjacent frames, establish a feature points’ motion vector space, and use improved K-means clustering for clustering. Finally, the richest cluster is being retained, and the global motion is obtained by homography transformation. Our proposed method has been verified on different types of videos and has efficient performance than traditional approaches. The stabilization video has an average improvement of 0.24 in the structural similarity index than the original video and 0.1 higher than the traditional method.
format Online
Article
Text
id pubmed-8038417
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-80384172021-04-12 Robust Global Motion Estimation for Video Stabilization Based on Improved K-Means Clustering and Superpixel Wu, Rouwan Xu, Zhiyong Zhang, Jianlin Zhang, Lihong Sensors (Basel) Article Obtaining accurate global motion is a crucial step for video stabilization. This paper proposes a robust and simple method to implement global motion estimation. We don’t extend the framework of 2D video stabilization but add a “plug and play” module to motion estimation based on feature points. Firstly, simple linear iterative clustering (SLIC) pre-segmentation is used to obtain superpixels of the video frame, clustering is performed according to the superpixel centroid motion vector and cluster center with large value is eliminated. Secondly, in order to obtain accurate global motion estimation, an improved K-means clustering is proposed. We match the feature points of the remaining superpixels between two adjacent frames, establish a feature points’ motion vector space, and use improved K-means clustering for clustering. Finally, the richest cluster is being retained, and the global motion is obtained by homography transformation. Our proposed method has been verified on different types of videos and has efficient performance than traditional approaches. The stabilization video has an average improvement of 0.24 in the structural similarity index than the original video and 0.1 higher than the traditional method. MDPI 2021-04-03 /pmc/articles/PMC8038417/ /pubmed/33916773 http://dx.doi.org/10.3390/s21072505 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Wu, Rouwan
Xu, Zhiyong
Zhang, Jianlin
Zhang, Lihong
Robust Global Motion Estimation for Video Stabilization Based on Improved K-Means Clustering and Superpixel
title Robust Global Motion Estimation for Video Stabilization Based on Improved K-Means Clustering and Superpixel
title_full Robust Global Motion Estimation for Video Stabilization Based on Improved K-Means Clustering and Superpixel
title_fullStr Robust Global Motion Estimation for Video Stabilization Based on Improved K-Means Clustering and Superpixel
title_full_unstemmed Robust Global Motion Estimation for Video Stabilization Based on Improved K-Means Clustering and Superpixel
title_short Robust Global Motion Estimation for Video Stabilization Based on Improved K-Means Clustering and Superpixel
title_sort robust global motion estimation for video stabilization based on improved k-means clustering and superpixel
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8038417/
https://www.ncbi.nlm.nih.gov/pubmed/33916773
http://dx.doi.org/10.3390/s21072505
work_keys_str_mv AT wurouwan robustglobalmotionestimationforvideostabilizationbasedonimprovedkmeansclusteringandsuperpixel
AT xuzhiyong robustglobalmotionestimationforvideostabilizationbasedonimprovedkmeansclusteringandsuperpixel
AT zhangjianlin robustglobalmotionestimationforvideostabilizationbasedonimprovedkmeansclusteringandsuperpixel
AT zhanglihong robustglobalmotionestimationforvideostabilizationbasedonimprovedkmeansclusteringandsuperpixel