Cargando…
High-Level Synthesis of Online K-Means Clustering Hardware for a Real-Time Image Processing Pipeline
The growing need for smart surveillance solutions requires that modern video capturing devices to be equipped with advance features, such as object detection, scene characterization, and event detection, etc. Image segmentation into various connected regions is a vital pre-processing step in these a...
Autores principales: | , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2019
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8320906/ https://www.ncbi.nlm.nih.gov/pubmed/34460466 http://dx.doi.org/10.3390/jimaging5030038 |
_version_ | 1783730724768055296 |
---|---|
author | Badawi, Aiman Bilal, Muhammad |
author_facet | Badawi, Aiman Bilal, Muhammad |
author_sort | Badawi, Aiman |
collection | PubMed |
description | The growing need for smart surveillance solutions requires that modern video capturing devices to be equipped with advance features, such as object detection, scene characterization, and event detection, etc. Image segmentation into various connected regions is a vital pre-processing step in these and other advanced computer vision algorithms. Thus, the inclusion of a hardware accelerator for this task in the conventional image processing pipeline inevitably reduces the workload for more advanced operations downstream. Moreover, design entry by using high-level synthesis tools is gaining popularity for the facilitation of system development under a rapid prototyping paradigm. To address these design requirements, we have developed a hardware accelerator for image segmentation, based on an online K-Means algorithm using a Simulink high-level synthesis tool. The developed hardware uses a standard pixel streaming protocol, and it can be readily inserted into any image processing pipeline as an Intellectual Property (IP) core on a Field Programmable Gate Array (FPGA). Furthermore, the proposed design reduces the hardware complexity of the conventional architectures by employing a weighted instead of a moving average to update the clusters. Experimental evidence has also been provided to demonstrate that the proposed weighted average-based approach yields better results than the conventional moving average on test video sequences. The synthesized hardware has been tested in real-time environment to process Full HD video at 26.5 fps, while the estimated dynamic power consumption is less than 90 mW on the Xilinx Zynq-7000 SOC. |
format | Online Article Text |
id | pubmed-8320906 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2019 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-83209062021-08-26 High-Level Synthesis of Online K-Means Clustering Hardware for a Real-Time Image Processing Pipeline Badawi, Aiman Bilal, Muhammad J Imaging Article The growing need for smart surveillance solutions requires that modern video capturing devices to be equipped with advance features, such as object detection, scene characterization, and event detection, etc. Image segmentation into various connected regions is a vital pre-processing step in these and other advanced computer vision algorithms. Thus, the inclusion of a hardware accelerator for this task in the conventional image processing pipeline inevitably reduces the workload for more advanced operations downstream. Moreover, design entry by using high-level synthesis tools is gaining popularity for the facilitation of system development under a rapid prototyping paradigm. To address these design requirements, we have developed a hardware accelerator for image segmentation, based on an online K-Means algorithm using a Simulink high-level synthesis tool. The developed hardware uses a standard pixel streaming protocol, and it can be readily inserted into any image processing pipeline as an Intellectual Property (IP) core on a Field Programmable Gate Array (FPGA). Furthermore, the proposed design reduces the hardware complexity of the conventional architectures by employing a weighted instead of a moving average to update the clusters. Experimental evidence has also been provided to demonstrate that the proposed weighted average-based approach yields better results than the conventional moving average on test video sequences. The synthesized hardware has been tested in real-time environment to process Full HD video at 26.5 fps, while the estimated dynamic power consumption is less than 90 mW on the Xilinx Zynq-7000 SOC. MDPI 2019-03-14 /pmc/articles/PMC8320906/ /pubmed/34460466 http://dx.doi.org/10.3390/jimaging5030038 Text en © 2019 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) ). |
spellingShingle | Article Badawi, Aiman Bilal, Muhammad High-Level Synthesis of Online K-Means Clustering Hardware for a Real-Time Image Processing Pipeline |
title | High-Level Synthesis of Online K-Means Clustering Hardware for a Real-Time Image Processing Pipeline |
title_full | High-Level Synthesis of Online K-Means Clustering Hardware for a Real-Time Image Processing Pipeline |
title_fullStr | High-Level Synthesis of Online K-Means Clustering Hardware for a Real-Time Image Processing Pipeline |
title_full_unstemmed | High-Level Synthesis of Online K-Means Clustering Hardware for a Real-Time Image Processing Pipeline |
title_short | High-Level Synthesis of Online K-Means Clustering Hardware for a Real-Time Image Processing Pipeline |
title_sort | high-level synthesis of online k-means clustering hardware for a real-time image processing pipeline |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8320906/ https://www.ncbi.nlm.nih.gov/pubmed/34460466 http://dx.doi.org/10.3390/jimaging5030038 |
work_keys_str_mv | AT badawiaiman highlevelsynthesisofonlinekmeansclusteringhardwareforarealtimeimageprocessingpipeline AT bilalmuhammad highlevelsynthesisofonlinekmeansclusteringhardwareforarealtimeimageprocessingpipeline |