Cargando…
Night Vision Anti-Halation Method Based on Infrared and Visible Video Fusion
In order to address the discontinuity caused by the direct application of the infrared and visible image fusion anti-halation method to a video, an efficient night vision anti-halation method based on video fusion is proposed. The designed frame selection based on inter-frame difference determines t...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9573233/ https://www.ncbi.nlm.nih.gov/pubmed/36236591 http://dx.doi.org/10.3390/s22197494 |
_version_ | 1784810817278967808 |
---|---|
author | Guo, Quanmin Wang, Hanlei Yang, Jianhua |
author_facet | Guo, Quanmin Wang, Hanlei Yang, Jianhua |
author_sort | Guo, Quanmin |
collection | PubMed |
description | In order to address the discontinuity caused by the direct application of the infrared and visible image fusion anti-halation method to a video, an efficient night vision anti-halation method based on video fusion is proposed. The designed frame selection based on inter-frame difference determines the optimal cosine angle threshold by analyzing the relation of cosine angle threshold with nonlinear correlation information entropy and de-frame rate. The proposed time-mark-based adaptive motion compensation constructs the same number of interpolation frames as the redundant frames by taking the retained frame number as a time stamp. At the same time, considering the motion vector of two adjacent retained frames as the benchmark, the adaptive weights are constructed according to the interframe differences between the interpolated frame and the last retained frame, then the motion vector of the interpolated frame is estimated. The experimental results show that the proposed frame selection strategy ensures the maximum safe frame removal under the premise of continuous video content at different vehicle speeds in various halation scenes. The frame numbers and playing duration of the fused video are consistent with that of the original video, and the content of the interpolated frame is highly synchronized with that of the corresponding original frames. The average FPS of video fusion in this work is about six times that in the frame-by-frame fusion, which effectively improves the anti-halation processing efficiency of video fusion. |
format | Online Article Text |
id | pubmed-9573233 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-95732332022-10-17 Night Vision Anti-Halation Method Based on Infrared and Visible Video Fusion Guo, Quanmin Wang, Hanlei Yang, Jianhua Sensors (Basel) Article In order to address the discontinuity caused by the direct application of the infrared and visible image fusion anti-halation method to a video, an efficient night vision anti-halation method based on video fusion is proposed. The designed frame selection based on inter-frame difference determines the optimal cosine angle threshold by analyzing the relation of cosine angle threshold with nonlinear correlation information entropy and de-frame rate. The proposed time-mark-based adaptive motion compensation constructs the same number of interpolation frames as the redundant frames by taking the retained frame number as a time stamp. At the same time, considering the motion vector of two adjacent retained frames as the benchmark, the adaptive weights are constructed according to the interframe differences between the interpolated frame and the last retained frame, then the motion vector of the interpolated frame is estimated. The experimental results show that the proposed frame selection strategy ensures the maximum safe frame removal under the premise of continuous video content at different vehicle speeds in various halation scenes. The frame numbers and playing duration of the fused video are consistent with that of the original video, and the content of the interpolated frame is highly synchronized with that of the corresponding original frames. The average FPS of video fusion in this work is about six times that in the frame-by-frame fusion, which effectively improves the anti-halation processing efficiency of video fusion. MDPI 2022-10-02 /pmc/articles/PMC9573233/ /pubmed/36236591 http://dx.doi.org/10.3390/s22197494 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Guo, Quanmin Wang, Hanlei Yang, Jianhua Night Vision Anti-Halation Method Based on Infrared and Visible Video Fusion |
title | Night Vision Anti-Halation Method Based on Infrared and Visible Video Fusion |
title_full | Night Vision Anti-Halation Method Based on Infrared and Visible Video Fusion |
title_fullStr | Night Vision Anti-Halation Method Based on Infrared and Visible Video Fusion |
title_full_unstemmed | Night Vision Anti-Halation Method Based on Infrared and Visible Video Fusion |
title_short | Night Vision Anti-Halation Method Based on Infrared and Visible Video Fusion |
title_sort | night vision anti-halation method based on infrared and visible video fusion |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9573233/ https://www.ncbi.nlm.nih.gov/pubmed/36236591 http://dx.doi.org/10.3390/s22197494 |
work_keys_str_mv | AT guoquanmin nightvisionantihalationmethodbasedoninfraredandvisiblevideofusion AT wanghanlei nightvisionantihalationmethodbasedoninfraredandvisiblevideofusion AT yangjianhua nightvisionantihalationmethodbasedoninfraredandvisiblevideofusion |