Cargando…
Multi illumination color constancy based on multi-scale supervision and single-scale estimation cascade convolution neural network
Color constancy methods are generally based on a simplifying assumption that the spectral distribution of a light source is uniform across scenes. However, in reality, this assumption is often violated because of the presence of multiple light sources, that is, more than two illuminations. In this p...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9783909/ https://www.ncbi.nlm.nih.gov/pubmed/36567878 http://dx.doi.org/10.3389/fninf.2022.953235 |
_version_ | 1784857685974319104 |
---|---|
author | Wang, Fei Wang, Wei Wu, Dan Gao, Guowang Wang, Zetian |
author_facet | Wang, Fei Wang, Wei Wu, Dan Gao, Guowang Wang, Zetian |
author_sort | Wang, Fei |
collection | PubMed |
description | Color constancy methods are generally based on a simplifying assumption that the spectral distribution of a light source is uniform across scenes. However, in reality, this assumption is often violated because of the presence of multiple light sources, that is, more than two illuminations. In this paper, we propose a unique cascade network of deep multi-scale supervision and single-scale estimation (CN-DMS4) to estimate multi-illumination. The network parameters are supervised and learned from coarse to fine in the training process and estimate only the final thinnest level illumination map in the illumination estimation process. Furthermore, to reduce the influence of the color channel on the Euclidean distance or the pixel-level angle error, a new loss function with a channel penalty term is designed to optimize the network parameters. Extensive experiments are conducted on single and multi-illumination benchmark datasets. In comparison with previous multi-illumination estimation methods, our proposed method displays a partial improvement in terms of quantitative data and visual effect, which provides the future research direction in end-to-end multi-illumination estimation. |
format | Online Article Text |
id | pubmed-9783909 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-97839092022-12-24 Multi illumination color constancy based on multi-scale supervision and single-scale estimation cascade convolution neural network Wang, Fei Wang, Wei Wu, Dan Gao, Guowang Wang, Zetian Front Neuroinform Neuroscience Color constancy methods are generally based on a simplifying assumption that the spectral distribution of a light source is uniform across scenes. However, in reality, this assumption is often violated because of the presence of multiple light sources, that is, more than two illuminations. In this paper, we propose a unique cascade network of deep multi-scale supervision and single-scale estimation (CN-DMS4) to estimate multi-illumination. The network parameters are supervised and learned from coarse to fine in the training process and estimate only the final thinnest level illumination map in the illumination estimation process. Furthermore, to reduce the influence of the color channel on the Euclidean distance or the pixel-level angle error, a new loss function with a channel penalty term is designed to optimize the network parameters. Extensive experiments are conducted on single and multi-illumination benchmark datasets. In comparison with previous multi-illumination estimation methods, our proposed method displays a partial improvement in terms of quantitative data and visual effect, which provides the future research direction in end-to-end multi-illumination estimation. Frontiers Media S.A. 2022-12-09 /pmc/articles/PMC9783909/ /pubmed/36567878 http://dx.doi.org/10.3389/fninf.2022.953235 Text en Copyright © 2022 Wang, Wang, Wu, Gao and Wang. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Neuroscience Wang, Fei Wang, Wei Wu, Dan Gao, Guowang Wang, Zetian Multi illumination color constancy based on multi-scale supervision and single-scale estimation cascade convolution neural network |
title | Multi illumination color constancy based on multi-scale supervision and single-scale estimation cascade convolution neural network |
title_full | Multi illumination color constancy based on multi-scale supervision and single-scale estimation cascade convolution neural network |
title_fullStr | Multi illumination color constancy based on multi-scale supervision and single-scale estimation cascade convolution neural network |
title_full_unstemmed | Multi illumination color constancy based on multi-scale supervision and single-scale estimation cascade convolution neural network |
title_short | Multi illumination color constancy based on multi-scale supervision and single-scale estimation cascade convolution neural network |
title_sort | multi illumination color constancy based on multi-scale supervision and single-scale estimation cascade convolution neural network |
topic | Neuroscience |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9783909/ https://www.ncbi.nlm.nih.gov/pubmed/36567878 http://dx.doi.org/10.3389/fninf.2022.953235 |
work_keys_str_mv | AT wangfei multiilluminationcolorconstancybasedonmultiscalesupervisionandsinglescaleestimationcascadeconvolutionneuralnetwork AT wangwei multiilluminationcolorconstancybasedonmultiscalesupervisionandsinglescaleestimationcascadeconvolutionneuralnetwork AT wudan multiilluminationcolorconstancybasedonmultiscalesupervisionandsinglescaleestimationcascadeconvolutionneuralnetwork AT gaoguowang multiilluminationcolorconstancybasedonmultiscalesupervisionandsinglescaleestimationcascadeconvolutionneuralnetwork AT wangzetian multiilluminationcolorconstancybasedonmultiscalesupervisionandsinglescaleestimationcascadeconvolutionneuralnetwork |