Cargando…

Stopping Criterion during Rendering of Computer-Generated Images Based on SVD-Entropy

The estimation of image quality and noise perception still remains an important issue in various image processing applications. It has also become a hot topic in the field of photo-realistic computer graphics where noise is inherent in the calculation process. Unlike natural-scene images, however, a...

Descripción completa

Detalles Bibliográficos
Autores principales: Buisine, Jérôme, Bigand, André, Synave, Rémi, Delepoulle, Samuel, Renaud, Christophe
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7825537/
https://www.ncbi.nlm.nih.gov/pubmed/33419115
http://dx.doi.org/10.3390/e23010075
_version_ 1783640329529851904
author Buisine, Jérôme
Bigand, André
Synave, Rémi
Delepoulle, Samuel
Renaud, Christophe
author_facet Buisine, Jérôme
Bigand, André
Synave, Rémi
Delepoulle, Samuel
Renaud, Christophe
author_sort Buisine, Jérôme
collection PubMed
description The estimation of image quality and noise perception still remains an important issue in various image processing applications. It has also become a hot topic in the field of photo-realistic computer graphics where noise is inherent in the calculation process. Unlike natural-scene images, however, a reference image is not available for computer-generated images. Thus, classic methods to assess noise quantity and stopping criterion during the rendering process are not usable. This is particularly important in the case of global illumination methods based on stochastic techniques: They provide photo-realistic images which are, however, corrupted by stochastic noise. This noise can be reduced by increasing the number of paths, as proved by Monte Carlo theory, but the problem of finding the right number of paths that are required in order to ensure that human observers cannot perceive any noise is still open. Until now, the features taking part in the human evaluation of image quality and the remaining perceived noise are not precisely known. Synthetic image generation tends to be very expensive and the produced datasets are high-dimensional datasets. In that case, finding a stopping criterion using a learning framework is a challenging task. In this paper, a new method for characterizing computational noise for computer generated images is presented. The noise is represented by the entropy of the singular value decomposition of each block composing an image. These Singular Value Decomposition (SVD)-entropy values are then used as input to a recurrent neural network architecture model in order to extract image noise and in predicting a visual convergence threshold of different parts of any image. Thus a new no-reference image quality assessment is proposed using the relation between SVD-Entropy and perceptual quality, based on a sequence of distorted images. Experiments show that the proposed method, compared with experimental psycho-visual scores, demonstrates a good consistency between these scores and stopping criterion measures that we obtain.
format Online
Article
Text
id pubmed-7825537
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-78255372021-02-24 Stopping Criterion during Rendering of Computer-Generated Images Based on SVD-Entropy Buisine, Jérôme Bigand, André Synave, Rémi Delepoulle, Samuel Renaud, Christophe Entropy (Basel) Article The estimation of image quality and noise perception still remains an important issue in various image processing applications. It has also become a hot topic in the field of photo-realistic computer graphics where noise is inherent in the calculation process. Unlike natural-scene images, however, a reference image is not available for computer-generated images. Thus, classic methods to assess noise quantity and stopping criterion during the rendering process are not usable. This is particularly important in the case of global illumination methods based on stochastic techniques: They provide photo-realistic images which are, however, corrupted by stochastic noise. This noise can be reduced by increasing the number of paths, as proved by Monte Carlo theory, but the problem of finding the right number of paths that are required in order to ensure that human observers cannot perceive any noise is still open. Until now, the features taking part in the human evaluation of image quality and the remaining perceived noise are not precisely known. Synthetic image generation tends to be very expensive and the produced datasets are high-dimensional datasets. In that case, finding a stopping criterion using a learning framework is a challenging task. In this paper, a new method for characterizing computational noise for computer generated images is presented. The noise is represented by the entropy of the singular value decomposition of each block composing an image. These Singular Value Decomposition (SVD)-entropy values are then used as input to a recurrent neural network architecture model in order to extract image noise and in predicting a visual convergence threshold of different parts of any image. Thus a new no-reference image quality assessment is proposed using the relation between SVD-Entropy and perceptual quality, based on a sequence of distorted images. Experiments show that the proposed method, compared with experimental psycho-visual scores, demonstrates a good consistency between these scores and stopping criterion measures that we obtain. MDPI 2021-01-06 /pmc/articles/PMC7825537/ /pubmed/33419115 http://dx.doi.org/10.3390/e23010075 Text en © 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Buisine, Jérôme
Bigand, André
Synave, Rémi
Delepoulle, Samuel
Renaud, Christophe
Stopping Criterion during Rendering of Computer-Generated Images Based on SVD-Entropy
title Stopping Criterion during Rendering of Computer-Generated Images Based on SVD-Entropy
title_full Stopping Criterion during Rendering of Computer-Generated Images Based on SVD-Entropy
title_fullStr Stopping Criterion during Rendering of Computer-Generated Images Based on SVD-Entropy
title_full_unstemmed Stopping Criterion during Rendering of Computer-Generated Images Based on SVD-Entropy
title_short Stopping Criterion during Rendering of Computer-Generated Images Based on SVD-Entropy
title_sort stopping criterion during rendering of computer-generated images based on svd-entropy
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7825537/
https://www.ncbi.nlm.nih.gov/pubmed/33419115
http://dx.doi.org/10.3390/e23010075
work_keys_str_mv AT buisinejerome stoppingcriterionduringrenderingofcomputergeneratedimagesbasedonsvdentropy
AT bigandandre stoppingcriterionduringrenderingofcomputergeneratedimagesbasedonsvdentropy
AT synaveremi stoppingcriterionduringrenderingofcomputergeneratedimagesbasedonsvdentropy
AT delepoullesamuel stoppingcriterionduringrenderingofcomputergeneratedimagesbasedonsvdentropy
AT renaudchristophe stoppingcriterionduringrenderingofcomputergeneratedimagesbasedonsvdentropy