Cargando…

Multi-Scale Attention-Guided Non-Local Network for HDR Image Reconstruction

High-dynamic-range (HDR) image reconstruction methods are designed to fuse multiple Low-dynamic-range (LDR) images captured with different exposure values into a single HDR image. Recent CNN-based methods mostly perform local attention- or alignment-based fusion of multiple LDR images to create HDR...

Descripción completa

Detalles Bibliográficos
Autores principales: Yoon, Howoon, Uddin, S. M. Nadim, Jung, Yong Ju
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9503481/
https://www.ncbi.nlm.nih.gov/pubmed/36146397
http://dx.doi.org/10.3390/s22187044
_version_ 1784795974145671168
author Yoon, Howoon
Uddin, S. M. Nadim
Jung, Yong Ju
author_facet Yoon, Howoon
Uddin, S. M. Nadim
Jung, Yong Ju
author_sort Yoon, Howoon
collection PubMed
description High-dynamic-range (HDR) image reconstruction methods are designed to fuse multiple Low-dynamic-range (LDR) images captured with different exposure values into a single HDR image. Recent CNN-based methods mostly perform local attention- or alignment-based fusion of multiple LDR images to create HDR contents. Depending on a single attention mechanism or alignment causes failure in compensating ghosting artifacts, which can arise in the synthesized HDR images due to the motion of objects or camera movement across different LDR image inputs. In this study, we propose a multi-scale attention-guided non-local network called MSANLnet for efficient HDR image reconstruction. To mitigate the ghosting artifacts, the proposed MSANLnet performs implicit alignment of LDR image features with multi-scale spatial attention modules and then reconstructs pixel intensity values using long-range dependencies through non-local means-based fusion. These modules adaptively select useful information that is not damaged by an object’s movement or unfavorable lighting conditions for image pixel fusion. Quantitative evaluations against several current state-of-the-art methods show that the proposed approach achieves higher performance than the existing methods. Moreover, comparative visual results show the effectiveness of the proposed method in restoring saturated information from original input images and mitigating ghosting artifacts caused by large movement of objects. Ablation studies show the effectiveness of the proposed method, architectural choices, and modules for efficient HDR reconstruction.
format Online
Article
Text
id pubmed-9503481
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-95034812022-09-24 Multi-Scale Attention-Guided Non-Local Network for HDR Image Reconstruction Yoon, Howoon Uddin, S. M. Nadim Jung, Yong Ju Sensors (Basel) Article High-dynamic-range (HDR) image reconstruction methods are designed to fuse multiple Low-dynamic-range (LDR) images captured with different exposure values into a single HDR image. Recent CNN-based methods mostly perform local attention- or alignment-based fusion of multiple LDR images to create HDR contents. Depending on a single attention mechanism or alignment causes failure in compensating ghosting artifacts, which can arise in the synthesized HDR images due to the motion of objects or camera movement across different LDR image inputs. In this study, we propose a multi-scale attention-guided non-local network called MSANLnet for efficient HDR image reconstruction. To mitigate the ghosting artifacts, the proposed MSANLnet performs implicit alignment of LDR image features with multi-scale spatial attention modules and then reconstructs pixel intensity values using long-range dependencies through non-local means-based fusion. These modules adaptively select useful information that is not damaged by an object’s movement or unfavorable lighting conditions for image pixel fusion. Quantitative evaluations against several current state-of-the-art methods show that the proposed approach achieves higher performance than the existing methods. Moreover, comparative visual results show the effectiveness of the proposed method in restoring saturated information from original input images and mitigating ghosting artifacts caused by large movement of objects. Ablation studies show the effectiveness of the proposed method, architectural choices, and modules for efficient HDR reconstruction. MDPI 2022-09-17 /pmc/articles/PMC9503481/ /pubmed/36146397 http://dx.doi.org/10.3390/s22187044 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Yoon, Howoon
Uddin, S. M. Nadim
Jung, Yong Ju
Multi-Scale Attention-Guided Non-Local Network for HDR Image Reconstruction
title Multi-Scale Attention-Guided Non-Local Network for HDR Image Reconstruction
title_full Multi-Scale Attention-Guided Non-Local Network for HDR Image Reconstruction
title_fullStr Multi-Scale Attention-Guided Non-Local Network for HDR Image Reconstruction
title_full_unstemmed Multi-Scale Attention-Guided Non-Local Network for HDR Image Reconstruction
title_short Multi-Scale Attention-Guided Non-Local Network for HDR Image Reconstruction
title_sort multi-scale attention-guided non-local network for hdr image reconstruction
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9503481/
https://www.ncbi.nlm.nih.gov/pubmed/36146397
http://dx.doi.org/10.3390/s22187044
work_keys_str_mv AT yoonhowoon multiscaleattentionguidednonlocalnetworkforhdrimagereconstruction
AT uddinsmnadim multiscaleattentionguidednonlocalnetworkforhdrimagereconstruction
AT jungyongju multiscaleattentionguidednonlocalnetworkforhdrimagereconstruction