Cargando…

An Optimization-Based Family of Predictive, Fusion-Based Models for Full-Reference Image Quality Assessment

Given the reference (distortion-free) image, full-reference image quality assessment (FR-IQA) algorithms seek to assess the perceptual quality of the test image. Over the years, many effective, hand-crafted FR-IQA metrics have been proposed in the literature. In this work, we present a novel framewo...

Descripción completa

Detalles Bibliográficos
Autor principal: Varga, Domonkos
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10299408/
https://www.ncbi.nlm.nih.gov/pubmed/37367464
http://dx.doi.org/10.3390/jimaging9060116
_version_ 1785064356642291712
author Varga, Domonkos
author_facet Varga, Domonkos
author_sort Varga, Domonkos
collection PubMed
description Given the reference (distortion-free) image, full-reference image quality assessment (FR-IQA) algorithms seek to assess the perceptual quality of the test image. Over the years, many effective, hand-crafted FR-IQA metrics have been proposed in the literature. In this work, we present a novel framework for FR-IQA that combines multiple metrics and tries to leverage the strength of each by formulating FR-IQA as an optimization problem. Following the idea of other fusion-based metrics, the perceptual quality of a test image is defined as the weighted product of several already existing, hand-crafted FR-IQA metrics. Unlike other methods, the weights are determined in an optimization-based framework and the objective function is defined to maximize the correlation and minimize the root mean square error between the predicted and ground-truth quality scores. The obtained metrics are evaluated on four popular benchmark IQA databases and compared to the state of the art. This comparison has revealed that the compiled fusion-based metrics are able to outperform other competing algorithms, including deep learning-based ones.
format Online
Article
Text
id pubmed-10299408
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-102994082023-06-28 An Optimization-Based Family of Predictive, Fusion-Based Models for Full-Reference Image Quality Assessment Varga, Domonkos J Imaging Article Given the reference (distortion-free) image, full-reference image quality assessment (FR-IQA) algorithms seek to assess the perceptual quality of the test image. Over the years, many effective, hand-crafted FR-IQA metrics have been proposed in the literature. In this work, we present a novel framework for FR-IQA that combines multiple metrics and tries to leverage the strength of each by formulating FR-IQA as an optimization problem. Following the idea of other fusion-based metrics, the perceptual quality of a test image is defined as the weighted product of several already existing, hand-crafted FR-IQA metrics. Unlike other methods, the weights are determined in an optimization-based framework and the objective function is defined to maximize the correlation and minimize the root mean square error between the predicted and ground-truth quality scores. The obtained metrics are evaluated on four popular benchmark IQA databases and compared to the state of the art. This comparison has revealed that the compiled fusion-based metrics are able to outperform other competing algorithms, including deep learning-based ones. MDPI 2023-06-08 /pmc/articles/PMC10299408/ /pubmed/37367464 http://dx.doi.org/10.3390/jimaging9060116 Text en © 2023 by the author. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Varga, Domonkos
An Optimization-Based Family of Predictive, Fusion-Based Models for Full-Reference Image Quality Assessment
title An Optimization-Based Family of Predictive, Fusion-Based Models for Full-Reference Image Quality Assessment
title_full An Optimization-Based Family of Predictive, Fusion-Based Models for Full-Reference Image Quality Assessment
title_fullStr An Optimization-Based Family of Predictive, Fusion-Based Models for Full-Reference Image Quality Assessment
title_full_unstemmed An Optimization-Based Family of Predictive, Fusion-Based Models for Full-Reference Image Quality Assessment
title_short An Optimization-Based Family of Predictive, Fusion-Based Models for Full-Reference Image Quality Assessment
title_sort optimization-based family of predictive, fusion-based models for full-reference image quality assessment
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10299408/
https://www.ncbi.nlm.nih.gov/pubmed/37367464
http://dx.doi.org/10.3390/jimaging9060116
work_keys_str_mv AT vargadomonkos anoptimizationbasedfamilyofpredictivefusionbasedmodelsforfullreferenceimagequalityassessment
AT vargadomonkos optimizationbasedfamilyofpredictivefusionbasedmodelsforfullreferenceimagequalityassessment