Cargando…

Multi illumination color constancy based on multi-scale supervision and single-scale estimation cascade convolution neural network

Color constancy methods are generally based on a simplifying assumption that the spectral distribution of a light source is uniform across scenes. However, in reality, this assumption is often violated because of the presence of multiple light sources, that is, more than two illuminations. In this p...

Descripción completa

Detalles Bibliográficos
Autores principales: Wang, Fei, Wang, Wei, Wu, Dan, Gao, Guowang, Wang, Zetian
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9783909/
https://www.ncbi.nlm.nih.gov/pubmed/36567878
http://dx.doi.org/10.3389/fninf.2022.953235
_version_ 1784857685974319104
author Wang, Fei
Wang, Wei
Wu, Dan
Gao, Guowang
Wang, Zetian
author_facet Wang, Fei
Wang, Wei
Wu, Dan
Gao, Guowang
Wang, Zetian
author_sort Wang, Fei
collection PubMed
description Color constancy methods are generally based on a simplifying assumption that the spectral distribution of a light source is uniform across scenes. However, in reality, this assumption is often violated because of the presence of multiple light sources, that is, more than two illuminations. In this paper, we propose a unique cascade network of deep multi-scale supervision and single-scale estimation (CN-DMS4) to estimate multi-illumination. The network parameters are supervised and learned from coarse to fine in the training process and estimate only the final thinnest level illumination map in the illumination estimation process. Furthermore, to reduce the influence of the color channel on the Euclidean distance or the pixel-level angle error, a new loss function with a channel penalty term is designed to optimize the network parameters. Extensive experiments are conducted on single and multi-illumination benchmark datasets. In comparison with previous multi-illumination estimation methods, our proposed method displays a partial improvement in terms of quantitative data and visual effect, which provides the future research direction in end-to-end multi-illumination estimation.
format Online
Article
Text
id pubmed-9783909
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-97839092022-12-24 Multi illumination color constancy based on multi-scale supervision and single-scale estimation cascade convolution neural network Wang, Fei Wang, Wei Wu, Dan Gao, Guowang Wang, Zetian Front Neuroinform Neuroscience Color constancy methods are generally based on a simplifying assumption that the spectral distribution of a light source is uniform across scenes. However, in reality, this assumption is often violated because of the presence of multiple light sources, that is, more than two illuminations. In this paper, we propose a unique cascade network of deep multi-scale supervision and single-scale estimation (CN-DMS4) to estimate multi-illumination. The network parameters are supervised and learned from coarse to fine in the training process and estimate only the final thinnest level illumination map in the illumination estimation process. Furthermore, to reduce the influence of the color channel on the Euclidean distance or the pixel-level angle error, a new loss function with a channel penalty term is designed to optimize the network parameters. Extensive experiments are conducted on single and multi-illumination benchmark datasets. In comparison with previous multi-illumination estimation methods, our proposed method displays a partial improvement in terms of quantitative data and visual effect, which provides the future research direction in end-to-end multi-illumination estimation. Frontiers Media S.A. 2022-12-09 /pmc/articles/PMC9783909/ /pubmed/36567878 http://dx.doi.org/10.3389/fninf.2022.953235 Text en Copyright © 2022 Wang, Wang, Wu, Gao and Wang. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Wang, Fei
Wang, Wei
Wu, Dan
Gao, Guowang
Wang, Zetian
Multi illumination color constancy based on multi-scale supervision and single-scale estimation cascade convolution neural network
title Multi illumination color constancy based on multi-scale supervision and single-scale estimation cascade convolution neural network
title_full Multi illumination color constancy based on multi-scale supervision and single-scale estimation cascade convolution neural network
title_fullStr Multi illumination color constancy based on multi-scale supervision and single-scale estimation cascade convolution neural network
title_full_unstemmed Multi illumination color constancy based on multi-scale supervision and single-scale estimation cascade convolution neural network
title_short Multi illumination color constancy based on multi-scale supervision and single-scale estimation cascade convolution neural network
title_sort multi illumination color constancy based on multi-scale supervision and single-scale estimation cascade convolution neural network
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9783909/
https://www.ncbi.nlm.nih.gov/pubmed/36567878
http://dx.doi.org/10.3389/fninf.2022.953235
work_keys_str_mv AT wangfei multiilluminationcolorconstancybasedonmultiscalesupervisionandsinglescaleestimationcascadeconvolutionneuralnetwork
AT wangwei multiilluminationcolorconstancybasedonmultiscalesupervisionandsinglescaleestimationcascadeconvolutionneuralnetwork
AT wudan multiilluminationcolorconstancybasedonmultiscalesupervisionandsinglescaleestimationcascadeconvolutionneuralnetwork
AT gaoguowang multiilluminationcolorconstancybasedonmultiscalesupervisionandsinglescaleestimationcascadeconvolutionneuralnetwork
AT wangzetian multiilluminationcolorconstancybasedonmultiscalesupervisionandsinglescaleestimationcascadeconvolutionneuralnetwork