Cargando…

Night Vision Anti-Halation Method Based on Infrared and Visible Video Fusion

In order to address the discontinuity caused by the direct application of the infrared and visible image fusion anti-halation method to a video, an efficient night vision anti-halation method based on video fusion is proposed. The designed frame selection based on inter-frame difference determines t...

Descripción completa

Detalles Bibliográficos
Autores principales: Guo, Quanmin, Wang, Hanlei, Yang, Jianhua
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9573233/
https://www.ncbi.nlm.nih.gov/pubmed/36236591
http://dx.doi.org/10.3390/s22197494
_version_ 1784810817278967808
author Guo, Quanmin
Wang, Hanlei
Yang, Jianhua
author_facet Guo, Quanmin
Wang, Hanlei
Yang, Jianhua
author_sort Guo, Quanmin
collection PubMed
description In order to address the discontinuity caused by the direct application of the infrared and visible image fusion anti-halation method to a video, an efficient night vision anti-halation method based on video fusion is proposed. The designed frame selection based on inter-frame difference determines the optimal cosine angle threshold by analyzing the relation of cosine angle threshold with nonlinear correlation information entropy and de-frame rate. The proposed time-mark-based adaptive motion compensation constructs the same number of interpolation frames as the redundant frames by taking the retained frame number as a time stamp. At the same time, considering the motion vector of two adjacent retained frames as the benchmark, the adaptive weights are constructed according to the interframe differences between the interpolated frame and the last retained frame, then the motion vector of the interpolated frame is estimated. The experimental results show that the proposed frame selection strategy ensures the maximum safe frame removal under the premise of continuous video content at different vehicle speeds in various halation scenes. The frame numbers and playing duration of the fused video are consistent with that of the original video, and the content of the interpolated frame is highly synchronized with that of the corresponding original frames. The average FPS of video fusion in this work is about six times that in the frame-by-frame fusion, which effectively improves the anti-halation processing efficiency of video fusion.
format Online
Article
Text
id pubmed-9573233
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-95732332022-10-17 Night Vision Anti-Halation Method Based on Infrared and Visible Video Fusion Guo, Quanmin Wang, Hanlei Yang, Jianhua Sensors (Basel) Article In order to address the discontinuity caused by the direct application of the infrared and visible image fusion anti-halation method to a video, an efficient night vision anti-halation method based on video fusion is proposed. The designed frame selection based on inter-frame difference determines the optimal cosine angle threshold by analyzing the relation of cosine angle threshold with nonlinear correlation information entropy and de-frame rate. The proposed time-mark-based adaptive motion compensation constructs the same number of interpolation frames as the redundant frames by taking the retained frame number as a time stamp. At the same time, considering the motion vector of two adjacent retained frames as the benchmark, the adaptive weights are constructed according to the interframe differences between the interpolated frame and the last retained frame, then the motion vector of the interpolated frame is estimated. The experimental results show that the proposed frame selection strategy ensures the maximum safe frame removal under the premise of continuous video content at different vehicle speeds in various halation scenes. The frame numbers and playing duration of the fused video are consistent with that of the original video, and the content of the interpolated frame is highly synchronized with that of the corresponding original frames. The average FPS of video fusion in this work is about six times that in the frame-by-frame fusion, which effectively improves the anti-halation processing efficiency of video fusion. MDPI 2022-10-02 /pmc/articles/PMC9573233/ /pubmed/36236591 http://dx.doi.org/10.3390/s22197494 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Guo, Quanmin
Wang, Hanlei
Yang, Jianhua
Night Vision Anti-Halation Method Based on Infrared and Visible Video Fusion
title Night Vision Anti-Halation Method Based on Infrared and Visible Video Fusion
title_full Night Vision Anti-Halation Method Based on Infrared and Visible Video Fusion
title_fullStr Night Vision Anti-Halation Method Based on Infrared and Visible Video Fusion
title_full_unstemmed Night Vision Anti-Halation Method Based on Infrared and Visible Video Fusion
title_short Night Vision Anti-Halation Method Based on Infrared and Visible Video Fusion
title_sort night vision anti-halation method based on infrared and visible video fusion
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9573233/
https://www.ncbi.nlm.nih.gov/pubmed/36236591
http://dx.doi.org/10.3390/s22197494
work_keys_str_mv AT guoquanmin nightvisionantihalationmethodbasedoninfraredandvisiblevideofusion
AT wanghanlei nightvisionantihalationmethodbasedoninfraredandvisiblevideofusion
AT yangjianhua nightvisionantihalationmethodbasedoninfraredandvisiblevideofusion