Cargando…

Infrared and Visible Image Fusion with Significant Target Enhancement

Existing fusion rules focus on retaining detailed information in the source image, but as the thermal radiation information in infrared images is mainly characterized by pixel intensity, these fusion rules are likely to result in reduced saliency of the target in the fused image. To address this pro...

Descripción completa

Detalles Bibliográficos
Autores principales: Huo, Xing, Deng, Yinping, Shao, Kun
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9689360/
https://www.ncbi.nlm.nih.gov/pubmed/36359722
http://dx.doi.org/10.3390/e24111633
_version_ 1784836513660403712
author Huo, Xing
Deng, Yinping
Shao, Kun
author_facet Huo, Xing
Deng, Yinping
Shao, Kun
author_sort Huo, Xing
collection PubMed
description Existing fusion rules focus on retaining detailed information in the source image, but as the thermal radiation information in infrared images is mainly characterized by pixel intensity, these fusion rules are likely to result in reduced saliency of the target in the fused image. To address this problem, we propose an infrared and visible image fusion model based on significant target enhancement, aiming to inject thermal targets from infrared images into visible images to enhance target saliency while retaining important details in visible images. First, the source image is decomposed with multi-level Gaussian curvature filtering to obtain background information with high spatial resolution. Second, the large-scale layers are fused using ResNet50 and maximizing weights based on the average operator to improve detail retention. Finally, the base layers are fused by incorporating a new salient target detection method. The subjective and objective experimental results on TNO and MSRS datasets demonstrate that our method achieves better results compared to other traditional and deep learning-based methods.
format Online
Article
Text
id pubmed-9689360
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-96893602022-11-25 Infrared and Visible Image Fusion with Significant Target Enhancement Huo, Xing Deng, Yinping Shao, Kun Entropy (Basel) Article Existing fusion rules focus on retaining detailed information in the source image, but as the thermal radiation information in infrared images is mainly characterized by pixel intensity, these fusion rules are likely to result in reduced saliency of the target in the fused image. To address this problem, we propose an infrared and visible image fusion model based on significant target enhancement, aiming to inject thermal targets from infrared images into visible images to enhance target saliency while retaining important details in visible images. First, the source image is decomposed with multi-level Gaussian curvature filtering to obtain background information with high spatial resolution. Second, the large-scale layers are fused using ResNet50 and maximizing weights based on the average operator to improve detail retention. Finally, the base layers are fused by incorporating a new salient target detection method. The subjective and objective experimental results on TNO and MSRS datasets demonstrate that our method achieves better results compared to other traditional and deep learning-based methods. MDPI 2022-11-10 /pmc/articles/PMC9689360/ /pubmed/36359722 http://dx.doi.org/10.3390/e24111633 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Huo, Xing
Deng, Yinping
Shao, Kun
Infrared and Visible Image Fusion with Significant Target Enhancement
title Infrared and Visible Image Fusion with Significant Target Enhancement
title_full Infrared and Visible Image Fusion with Significant Target Enhancement
title_fullStr Infrared and Visible Image Fusion with Significant Target Enhancement
title_full_unstemmed Infrared and Visible Image Fusion with Significant Target Enhancement
title_short Infrared and Visible Image Fusion with Significant Target Enhancement
title_sort infrared and visible image fusion with significant target enhancement
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9689360/
https://www.ncbi.nlm.nih.gov/pubmed/36359722
http://dx.doi.org/10.3390/e24111633
work_keys_str_mv AT huoxing infraredandvisibleimagefusionwithsignificanttargetenhancement
AT dengyinping infraredandvisibleimagefusionwithsignificanttargetenhancement
AT shaokun infraredandvisibleimagefusionwithsignificanttargetenhancement