Cargando…

An Adaptive Exposure Fusion Method Using Fuzzy Logic and Multivariate Normal Conditional Random Fields

High dynamic range (HDR) has wide applications involving intelligent vision sensing which includes enhanced electronic imaging, smart surveillance, self-driving cars, intelligent medical diagnosis, etc. Exposure fusion is an essential HDR technique which fuses different exposures of the same scene i...

Descripción completa

Detalles Bibliográficos
Autores principales: Lin, Yu-Hsiu, Hua, Kai-Lung, Lu, Hsin-Han, Sun, Wei-Lun, Chen, Yung-Yao
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2019
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6864834/
https://www.ncbi.nlm.nih.gov/pubmed/31683704
http://dx.doi.org/10.3390/s19214743
_version_ 1783471972165877760
author Lin, Yu-Hsiu
Hua, Kai-Lung
Lu, Hsin-Han
Sun, Wei-Lun
Chen, Yung-Yao
author_facet Lin, Yu-Hsiu
Hua, Kai-Lung
Lu, Hsin-Han
Sun, Wei-Lun
Chen, Yung-Yao
author_sort Lin, Yu-Hsiu
collection PubMed
description High dynamic range (HDR) has wide applications involving intelligent vision sensing which includes enhanced electronic imaging, smart surveillance, self-driving cars, intelligent medical diagnosis, etc. Exposure fusion is an essential HDR technique which fuses different exposures of the same scene into an HDR-like image. However, determining the appropriate fusion weights is difficult because each differently exposed image only contains a subset of the scene’s details. When blending, the problem of local color inconsistency is more challenging; thus, it often requires manual tuning to avoid image artifacts. To address this problem, we present an adaptive coarse-to-fine searching approach to find the optimal fusion weights. In the coarse-tuning stage, fuzzy logic is used to efficiently decide the initial weights. In the fine-tuning stage, the multivariate normal conditional random field model is used to adjust the fuzzy-based initial weights which allows us to consider both intra- and inter-image information in the data. Moreover, a multiscale enhanced fusion scheme is proposed to blend input images when maintaining the details in each scale-level. The proposed fuzzy-based MNCRF (Multivariate Normal Conditional Random Fields) fusion method provided a smoother blending result and a more natural look. Meanwhile, the details in the highlighted and dark regions were preserved simultaneously. The experimental results demonstrated that our work outperformed the state-of-the-art methods not only in several objective quality measures but also in a user study analysis.
format Online
Article
Text
id pubmed-6864834
institution National Center for Biotechnology Information
language English
publishDate 2019
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-68648342019-12-06 An Adaptive Exposure Fusion Method Using Fuzzy Logic and Multivariate Normal Conditional Random Fields Lin, Yu-Hsiu Hua, Kai-Lung Lu, Hsin-Han Sun, Wei-Lun Chen, Yung-Yao Sensors (Basel) Article High dynamic range (HDR) has wide applications involving intelligent vision sensing which includes enhanced electronic imaging, smart surveillance, self-driving cars, intelligent medical diagnosis, etc. Exposure fusion is an essential HDR technique which fuses different exposures of the same scene into an HDR-like image. However, determining the appropriate fusion weights is difficult because each differently exposed image only contains a subset of the scene’s details. When blending, the problem of local color inconsistency is more challenging; thus, it often requires manual tuning to avoid image artifacts. To address this problem, we present an adaptive coarse-to-fine searching approach to find the optimal fusion weights. In the coarse-tuning stage, fuzzy logic is used to efficiently decide the initial weights. In the fine-tuning stage, the multivariate normal conditional random field model is used to adjust the fuzzy-based initial weights which allows us to consider both intra- and inter-image information in the data. Moreover, a multiscale enhanced fusion scheme is proposed to blend input images when maintaining the details in each scale-level. The proposed fuzzy-based MNCRF (Multivariate Normal Conditional Random Fields) fusion method provided a smoother blending result and a more natural look. Meanwhile, the details in the highlighted and dark regions were preserved simultaneously. The experimental results demonstrated that our work outperformed the state-of-the-art methods not only in several objective quality measures but also in a user study analysis. MDPI 2019-10-31 /pmc/articles/PMC6864834/ /pubmed/31683704 http://dx.doi.org/10.3390/s19214743 Text en © 2019 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Lin, Yu-Hsiu
Hua, Kai-Lung
Lu, Hsin-Han
Sun, Wei-Lun
Chen, Yung-Yao
An Adaptive Exposure Fusion Method Using Fuzzy Logic and Multivariate Normal Conditional Random Fields
title An Adaptive Exposure Fusion Method Using Fuzzy Logic and Multivariate Normal Conditional Random Fields
title_full An Adaptive Exposure Fusion Method Using Fuzzy Logic and Multivariate Normal Conditional Random Fields
title_fullStr An Adaptive Exposure Fusion Method Using Fuzzy Logic and Multivariate Normal Conditional Random Fields
title_full_unstemmed An Adaptive Exposure Fusion Method Using Fuzzy Logic and Multivariate Normal Conditional Random Fields
title_short An Adaptive Exposure Fusion Method Using Fuzzy Logic and Multivariate Normal Conditional Random Fields
title_sort adaptive exposure fusion method using fuzzy logic and multivariate normal conditional random fields
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6864834/
https://www.ncbi.nlm.nih.gov/pubmed/31683704
http://dx.doi.org/10.3390/s19214743
work_keys_str_mv AT linyuhsiu anadaptiveexposurefusionmethodusingfuzzylogicandmultivariatenormalconditionalrandomfields
AT huakailung anadaptiveexposurefusionmethodusingfuzzylogicandmultivariatenormalconditionalrandomfields
AT luhsinhan anadaptiveexposurefusionmethodusingfuzzylogicandmultivariatenormalconditionalrandomfields
AT sunweilun anadaptiveexposurefusionmethodusingfuzzylogicandmultivariatenormalconditionalrandomfields
AT chenyungyao anadaptiveexposurefusionmethodusingfuzzylogicandmultivariatenormalconditionalrandomfields
AT linyuhsiu adaptiveexposurefusionmethodusingfuzzylogicandmultivariatenormalconditionalrandomfields
AT huakailung adaptiveexposurefusionmethodusingfuzzylogicandmultivariatenormalconditionalrandomfields
AT luhsinhan adaptiveexposurefusionmethodusingfuzzylogicandmultivariatenormalconditionalrandomfields
AT sunweilun adaptiveexposurefusionmethodusingfuzzylogicandmultivariatenormalconditionalrandomfields
AT chenyungyao adaptiveexposurefusionmethodusingfuzzylogicandmultivariatenormalconditionalrandomfields