Cargando…
Multi-Scale Attention-Guided Non-Local Network for HDR Image Reconstruction
High-dynamic-range (HDR) image reconstruction methods are designed to fuse multiple Low-dynamic-range (LDR) images captured with different exposure values into a single HDR image. Recent CNN-based methods mostly perform local attention- or alignment-based fusion of multiple LDR images to create HDR...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9503481/ https://www.ncbi.nlm.nih.gov/pubmed/36146397 http://dx.doi.org/10.3390/s22187044 |
_version_ | 1784795974145671168 |
---|---|
author | Yoon, Howoon Uddin, S. M. Nadim Jung, Yong Ju |
author_facet | Yoon, Howoon Uddin, S. M. Nadim Jung, Yong Ju |
author_sort | Yoon, Howoon |
collection | PubMed |
description | High-dynamic-range (HDR) image reconstruction methods are designed to fuse multiple Low-dynamic-range (LDR) images captured with different exposure values into a single HDR image. Recent CNN-based methods mostly perform local attention- or alignment-based fusion of multiple LDR images to create HDR contents. Depending on a single attention mechanism or alignment causes failure in compensating ghosting artifacts, which can arise in the synthesized HDR images due to the motion of objects or camera movement across different LDR image inputs. In this study, we propose a multi-scale attention-guided non-local network called MSANLnet for efficient HDR image reconstruction. To mitigate the ghosting artifacts, the proposed MSANLnet performs implicit alignment of LDR image features with multi-scale spatial attention modules and then reconstructs pixel intensity values using long-range dependencies through non-local means-based fusion. These modules adaptively select useful information that is not damaged by an object’s movement or unfavorable lighting conditions for image pixel fusion. Quantitative evaluations against several current state-of-the-art methods show that the proposed approach achieves higher performance than the existing methods. Moreover, comparative visual results show the effectiveness of the proposed method in restoring saturated information from original input images and mitigating ghosting artifacts caused by large movement of objects. Ablation studies show the effectiveness of the proposed method, architectural choices, and modules for efficient HDR reconstruction. |
format | Online Article Text |
id | pubmed-9503481 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-95034812022-09-24 Multi-Scale Attention-Guided Non-Local Network for HDR Image Reconstruction Yoon, Howoon Uddin, S. M. Nadim Jung, Yong Ju Sensors (Basel) Article High-dynamic-range (HDR) image reconstruction methods are designed to fuse multiple Low-dynamic-range (LDR) images captured with different exposure values into a single HDR image. Recent CNN-based methods mostly perform local attention- or alignment-based fusion of multiple LDR images to create HDR contents. Depending on a single attention mechanism or alignment causes failure in compensating ghosting artifacts, which can arise in the synthesized HDR images due to the motion of objects or camera movement across different LDR image inputs. In this study, we propose a multi-scale attention-guided non-local network called MSANLnet for efficient HDR image reconstruction. To mitigate the ghosting artifacts, the proposed MSANLnet performs implicit alignment of LDR image features with multi-scale spatial attention modules and then reconstructs pixel intensity values using long-range dependencies through non-local means-based fusion. These modules adaptively select useful information that is not damaged by an object’s movement or unfavorable lighting conditions for image pixel fusion. Quantitative evaluations against several current state-of-the-art methods show that the proposed approach achieves higher performance than the existing methods. Moreover, comparative visual results show the effectiveness of the proposed method in restoring saturated information from original input images and mitigating ghosting artifacts caused by large movement of objects. Ablation studies show the effectiveness of the proposed method, architectural choices, and modules for efficient HDR reconstruction. MDPI 2022-09-17 /pmc/articles/PMC9503481/ /pubmed/36146397 http://dx.doi.org/10.3390/s22187044 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Yoon, Howoon Uddin, S. M. Nadim Jung, Yong Ju Multi-Scale Attention-Guided Non-Local Network for HDR Image Reconstruction |
title | Multi-Scale Attention-Guided Non-Local Network for HDR Image Reconstruction |
title_full | Multi-Scale Attention-Guided Non-Local Network for HDR Image Reconstruction |
title_fullStr | Multi-Scale Attention-Guided Non-Local Network for HDR Image Reconstruction |
title_full_unstemmed | Multi-Scale Attention-Guided Non-Local Network for HDR Image Reconstruction |
title_short | Multi-Scale Attention-Guided Non-Local Network for HDR Image Reconstruction |
title_sort | multi-scale attention-guided non-local network for hdr image reconstruction |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9503481/ https://www.ncbi.nlm.nih.gov/pubmed/36146397 http://dx.doi.org/10.3390/s22187044 |
work_keys_str_mv | AT yoonhowoon multiscaleattentionguidednonlocalnetworkforhdrimagereconstruction AT uddinsmnadim multiscaleattentionguidednonlocalnetworkforhdrimagereconstruction AT jungyongju multiscaleattentionguidednonlocalnetworkforhdrimagereconstruction |