Cargando…

Single-Image Visibility Restoration: A Machine Learning Approach and Its 4K-Capable Hardware Accelerator

In recent years, machine vision algorithms have played an influential role as core technologies in several practical applications, such as surveillance, autonomous driving, and object recognition/localization. However, as almost all such algorithms are applicable to clear weather conditions, their p...

Descripción completa

Detalles Bibliográficos
Autores principales: Ngo, Dat, Lee, Seungmin, Lee, Gi-Dong, Kang, Bongsoon
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7602124/
https://www.ncbi.nlm.nih.gov/pubmed/33066285
http://dx.doi.org/10.3390/s20205795
_version_ 1783603597854900224
author Ngo, Dat
Lee, Seungmin
Lee, Gi-Dong
Kang, Bongsoon
author_facet Ngo, Dat
Lee, Seungmin
Lee, Gi-Dong
Kang, Bongsoon
author_sort Ngo, Dat
collection PubMed
description In recent years, machine vision algorithms have played an influential role as core technologies in several practical applications, such as surveillance, autonomous driving, and object recognition/localization. However, as almost all such algorithms are applicable to clear weather conditions, their performance is severely affected by any atmospheric turbidity. Several image visibility restoration algorithms have been proposed to address this issue, and they have proven to be a highly efficient solution. This paper proposes a novel method to recover clear images from degraded ones. To this end, the proposed algorithm uses a supervised machine learning-based technique to estimate the pixel-wise extinction coefficients of the transmission medium and a novel compensation scheme to rectify the post-dehazing false enlargement of white objects. Also, a corresponding hardware accelerator implemented on a Field Programmable Gate Array chip is in order for facilitating real-time processing, a critical requirement of practical camera-based systems. Experimental results on both synthetic and real image datasets verified the proposed method’s superiority over existing benchmark approaches. Furthermore, the hardware synthesis results revealed that the accelerator exhibits a processing rate of nearly 271.67 Mpixel/s, enabling it to process 4K videos at 30.7 frames per second in real time.
format Online
Article
Text
id pubmed-7602124
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-76021242020-11-01 Single-Image Visibility Restoration: A Machine Learning Approach and Its 4K-Capable Hardware Accelerator Ngo, Dat Lee, Seungmin Lee, Gi-Dong Kang, Bongsoon Sensors (Basel) Article In recent years, machine vision algorithms have played an influential role as core technologies in several practical applications, such as surveillance, autonomous driving, and object recognition/localization. However, as almost all such algorithms are applicable to clear weather conditions, their performance is severely affected by any atmospheric turbidity. Several image visibility restoration algorithms have been proposed to address this issue, and they have proven to be a highly efficient solution. This paper proposes a novel method to recover clear images from degraded ones. To this end, the proposed algorithm uses a supervised machine learning-based technique to estimate the pixel-wise extinction coefficients of the transmission medium and a novel compensation scheme to rectify the post-dehazing false enlargement of white objects. Also, a corresponding hardware accelerator implemented on a Field Programmable Gate Array chip is in order for facilitating real-time processing, a critical requirement of practical camera-based systems. Experimental results on both synthetic and real image datasets verified the proposed method’s superiority over existing benchmark approaches. Furthermore, the hardware synthesis results revealed that the accelerator exhibits a processing rate of nearly 271.67 Mpixel/s, enabling it to process 4K videos at 30.7 frames per second in real time. MDPI 2020-10-13 /pmc/articles/PMC7602124/ /pubmed/33066285 http://dx.doi.org/10.3390/s20205795 Text en © 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Ngo, Dat
Lee, Seungmin
Lee, Gi-Dong
Kang, Bongsoon
Single-Image Visibility Restoration: A Machine Learning Approach and Its 4K-Capable Hardware Accelerator
title Single-Image Visibility Restoration: A Machine Learning Approach and Its 4K-Capable Hardware Accelerator
title_full Single-Image Visibility Restoration: A Machine Learning Approach and Its 4K-Capable Hardware Accelerator
title_fullStr Single-Image Visibility Restoration: A Machine Learning Approach and Its 4K-Capable Hardware Accelerator
title_full_unstemmed Single-Image Visibility Restoration: A Machine Learning Approach and Its 4K-Capable Hardware Accelerator
title_short Single-Image Visibility Restoration: A Machine Learning Approach and Its 4K-Capable Hardware Accelerator
title_sort single-image visibility restoration: a machine learning approach and its 4k-capable hardware accelerator
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7602124/
https://www.ncbi.nlm.nih.gov/pubmed/33066285
http://dx.doi.org/10.3390/s20205795
work_keys_str_mv AT ngodat singleimagevisibilityrestorationamachinelearningapproachandits4kcapablehardwareaccelerator
AT leeseungmin singleimagevisibilityrestorationamachinelearningapproachandits4kcapablehardwareaccelerator
AT leegidong singleimagevisibilityrestorationamachinelearningapproachandits4kcapablehardwareaccelerator
AT kangbongsoon singleimagevisibilityrestorationamachinelearningapproachandits4kcapablehardwareaccelerator