Cargando…

Infrared and Visible Image Fusion Technology and Application: A Review

The images acquired by a single visible light sensor are very susceptible to light conditions, weather changes, and other factors, while the images acquired by a single infrared light sensor generally have poor resolution, low contrast, low signal-to-noise ratio, and blurred visual effects. The fusi...

Descripción completa

Detalles Bibliográficos
Autores principales: Ma, Weihong, Wang, Kun, Li, Jiawei, Yang, Simon X., Li, Junfei, Song, Lepeng, Li, Qifeng
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9862268/
https://www.ncbi.nlm.nih.gov/pubmed/36679396
http://dx.doi.org/10.3390/s23020599
_version_ 1784875050988470272
author Ma, Weihong
Wang, Kun
Li, Jiawei
Yang, Simon X.
Li, Junfei
Song, Lepeng
Li, Qifeng
author_facet Ma, Weihong
Wang, Kun
Li, Jiawei
Yang, Simon X.
Li, Junfei
Song, Lepeng
Li, Qifeng
author_sort Ma, Weihong
collection PubMed
description The images acquired by a single visible light sensor are very susceptible to light conditions, weather changes, and other factors, while the images acquired by a single infrared light sensor generally have poor resolution, low contrast, low signal-to-noise ratio, and blurred visual effects. The fusion of visible and infrared light can avoid the disadvantages of two single sensors and, in fusing the advantages of both sensors, significantly improve the quality of the images. The fusion of infrared and visible images is widely used in agriculture, industry, medicine, and other fields. In this study, firstly, the architecture of mainstream infrared and visible image fusion technology and application was reviewed; secondly, the application status in robot vision, medical imaging, agricultural remote sensing, and industrial defect detection fields was discussed; thirdly, the evaluation indicators of the main image fusion methods were combined into the subjective evaluation and the objective evaluation, the properties of current mainstream technologies were then specifically analyzed and compared, and the outlook for image fusion was assessed; finally, infrared and visible image fusion was summarized. The results show that the definition and efficiency of the fused infrared and visible image had been improved significantly. However, there were still some problems, such as the poor accuracy of the fused image, and irretrievably lost pixels. There is a need to improve the adaptive design of the traditional algorithm parameters, to combine the innovation of the fusion algorithm and the optimization of the neural network, so as to further improve the image fusion accuracy, reduce noise interference, and improve the real-time performance of the algorithm.
format Online
Article
Text
id pubmed-9862268
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-98622682023-01-22 Infrared and Visible Image Fusion Technology and Application: A Review Ma, Weihong Wang, Kun Li, Jiawei Yang, Simon X. Li, Junfei Song, Lepeng Li, Qifeng Sensors (Basel) Review The images acquired by a single visible light sensor are very susceptible to light conditions, weather changes, and other factors, while the images acquired by a single infrared light sensor generally have poor resolution, low contrast, low signal-to-noise ratio, and blurred visual effects. The fusion of visible and infrared light can avoid the disadvantages of two single sensors and, in fusing the advantages of both sensors, significantly improve the quality of the images. The fusion of infrared and visible images is widely used in agriculture, industry, medicine, and other fields. In this study, firstly, the architecture of mainstream infrared and visible image fusion technology and application was reviewed; secondly, the application status in robot vision, medical imaging, agricultural remote sensing, and industrial defect detection fields was discussed; thirdly, the evaluation indicators of the main image fusion methods were combined into the subjective evaluation and the objective evaluation, the properties of current mainstream technologies were then specifically analyzed and compared, and the outlook for image fusion was assessed; finally, infrared and visible image fusion was summarized. The results show that the definition and efficiency of the fused infrared and visible image had been improved significantly. However, there were still some problems, such as the poor accuracy of the fused image, and irretrievably lost pixels. There is a need to improve the adaptive design of the traditional algorithm parameters, to combine the innovation of the fusion algorithm and the optimization of the neural network, so as to further improve the image fusion accuracy, reduce noise interference, and improve the real-time performance of the algorithm. MDPI 2023-01-04 /pmc/articles/PMC9862268/ /pubmed/36679396 http://dx.doi.org/10.3390/s23020599 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Review
Ma, Weihong
Wang, Kun
Li, Jiawei
Yang, Simon X.
Li, Junfei
Song, Lepeng
Li, Qifeng
Infrared and Visible Image Fusion Technology and Application: A Review
title Infrared and Visible Image Fusion Technology and Application: A Review
title_full Infrared and Visible Image Fusion Technology and Application: A Review
title_fullStr Infrared and Visible Image Fusion Technology and Application: A Review
title_full_unstemmed Infrared and Visible Image Fusion Technology and Application: A Review
title_short Infrared and Visible Image Fusion Technology and Application: A Review
title_sort infrared and visible image fusion technology and application: a review
topic Review
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9862268/
https://www.ncbi.nlm.nih.gov/pubmed/36679396
http://dx.doi.org/10.3390/s23020599
work_keys_str_mv AT maweihong infraredandvisibleimagefusiontechnologyandapplicationareview
AT wangkun infraredandvisibleimagefusiontechnologyandapplicationareview
AT lijiawei infraredandvisibleimagefusiontechnologyandapplicationareview
AT yangsimonx infraredandvisibleimagefusiontechnologyandapplicationareview
AT lijunfei infraredandvisibleimagefusiontechnologyandapplicationareview
AT songlepeng infraredandvisibleimagefusiontechnologyandapplicationareview
AT liqifeng infraredandvisibleimagefusiontechnologyandapplicationareview