Cargando…

Performance Comparison of Classical Methods and Neural Networks for Colour Correction

Colour correction is the process of converting RAW RGB pixel values of digital cameras to a standard colour space such as CIE XYZ. A range of regression methods including linear, polynomial and root-polynomial least-squares have been deployed. However, in recent years, various neural network (NN) mo...

Descripción completa

Detalles Bibliográficos
Autores principales: Kucuk, Abdullah, Finlayson, Graham D., Mantiuk, Rafal, Ashraf, Maliha
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10607821/
https://www.ncbi.nlm.nih.gov/pubmed/37888321
http://dx.doi.org/10.3390/jimaging9100214
_version_ 1785127633238884352
author Kucuk, Abdullah
Finlayson, Graham D.
Mantiuk, Rafal
Ashraf, Maliha
author_facet Kucuk, Abdullah
Finlayson, Graham D.
Mantiuk, Rafal
Ashraf, Maliha
author_sort Kucuk, Abdullah
collection PubMed
description Colour correction is the process of converting RAW RGB pixel values of digital cameras to a standard colour space such as CIE XYZ. A range of regression methods including linear, polynomial and root-polynomial least-squares have been deployed. However, in recent years, various neural network (NN) models have also started to appear in the literature as an alternative to classical methods. In the first part of this paper, a leading neural network approach is compared and contrasted with regression methods. We find that, although the neural network model supports improved colour correction compared with simple least-squares regression, it performs less well than the more advanced root-polynomial regression. Moreover, the relative improvement afforded by NNs, compared to linear least-squares, is diminished when the regression methods are adapted to minimise a perceptual colour error. Problematically, unlike linear and root-polynomial regressions, the NN approach is tied to a fixed exposure (and when exposure changes, the afforded colour correction can be quite poor). We explore two solutions that make NNs more exposure-invariant. First, we use data augmentation to train the NN for a range of typical exposures and second, we propose a new NN architecture which, by construction, is exposure-invariant. Finally, we look into how the performance of these algorithms is influenced when models are trained and tested on different datasets. As expected, the performance of all methods drops when tested with completely different datasets. However, we noticed that the regression methods still outperform the NNs in terms of colour correction, even though the relative performance of the regression methods does change based on the train and test datasets.
format Online
Article
Text
id pubmed-10607821
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-106078212023-10-28 Performance Comparison of Classical Methods and Neural Networks for Colour Correction Kucuk, Abdullah Finlayson, Graham D. Mantiuk, Rafal Ashraf, Maliha J Imaging Article Colour correction is the process of converting RAW RGB pixel values of digital cameras to a standard colour space such as CIE XYZ. A range of regression methods including linear, polynomial and root-polynomial least-squares have been deployed. However, in recent years, various neural network (NN) models have also started to appear in the literature as an alternative to classical methods. In the first part of this paper, a leading neural network approach is compared and contrasted with regression methods. We find that, although the neural network model supports improved colour correction compared with simple least-squares regression, it performs less well than the more advanced root-polynomial regression. Moreover, the relative improvement afforded by NNs, compared to linear least-squares, is diminished when the regression methods are adapted to minimise a perceptual colour error. Problematically, unlike linear and root-polynomial regressions, the NN approach is tied to a fixed exposure (and when exposure changes, the afforded colour correction can be quite poor). We explore two solutions that make NNs more exposure-invariant. First, we use data augmentation to train the NN for a range of typical exposures and second, we propose a new NN architecture which, by construction, is exposure-invariant. Finally, we look into how the performance of these algorithms is influenced when models are trained and tested on different datasets. As expected, the performance of all methods drops when tested with completely different datasets. However, we noticed that the regression methods still outperform the NNs in terms of colour correction, even though the relative performance of the regression methods does change based on the train and test datasets. MDPI 2023-10-07 /pmc/articles/PMC10607821/ /pubmed/37888321 http://dx.doi.org/10.3390/jimaging9100214 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Kucuk, Abdullah
Finlayson, Graham D.
Mantiuk, Rafal
Ashraf, Maliha
Performance Comparison of Classical Methods and Neural Networks for Colour Correction
title Performance Comparison of Classical Methods and Neural Networks for Colour Correction
title_full Performance Comparison of Classical Methods and Neural Networks for Colour Correction
title_fullStr Performance Comparison of Classical Methods and Neural Networks for Colour Correction
title_full_unstemmed Performance Comparison of Classical Methods and Neural Networks for Colour Correction
title_short Performance Comparison of Classical Methods and Neural Networks for Colour Correction
title_sort performance comparison of classical methods and neural networks for colour correction
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10607821/
https://www.ncbi.nlm.nih.gov/pubmed/37888321
http://dx.doi.org/10.3390/jimaging9100214
work_keys_str_mv AT kucukabdullah performancecomparisonofclassicalmethodsandneuralnetworksforcolourcorrection
AT finlaysongrahamd performancecomparisonofclassicalmethodsandneuralnetworksforcolourcorrection
AT mantiukrafal performancecomparisonofclassicalmethodsandneuralnetworksforcolourcorrection
AT ashrafmaliha performancecomparisonofclassicalmethodsandneuralnetworksforcolourcorrection