Cargando…

Blind Tone-Mapped Image Quality Assessment Based on Regional Sparse Response and Aesthetics

High dynamic range (HDR) images give a strong disposition to capture all parts of natural scene information due to their wider brightness range than traditional low dynamic range (LDR) images. However, to visualize HDR images on common LDR displays, tone mapping operations (TMOs) are extra required,...

Descripción completa

Detalles Bibliográficos
Autores principales: He, Zhouyan, Yu, Mei, Chen, Fen, Peng, Zongju, Xu, Haiyong, Song, Yang
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7517451/
https://www.ncbi.nlm.nih.gov/pubmed/33286621
http://dx.doi.org/10.3390/e22080850
_version_ 1783587228431155200
author He, Zhouyan
Yu, Mei
Chen, Fen
Peng, Zongju
Xu, Haiyong
Song, Yang
author_facet He, Zhouyan
Yu, Mei
Chen, Fen
Peng, Zongju
Xu, Haiyong
Song, Yang
author_sort He, Zhouyan
collection PubMed
description High dynamic range (HDR) images give a strong disposition to capture all parts of natural scene information due to their wider brightness range than traditional low dynamic range (LDR) images. However, to visualize HDR images on common LDR displays, tone mapping operations (TMOs) are extra required, which inevitably lead to visual quality degradation, especially in the bright and dark regions. To evaluate the performance of different TMOs accurately, this paper proposes a blind tone-mapped image quality assessment method based on regional sparse response and aesthetics (RSRA-BTMI) by considering the influences of detail information and color on the human visual system. Specifically, for the detail loss in a tone-mapped image (TMI), multi-dictionaries are first designed for different brightness regions and whole TMI. Then regional sparse atoms aggregated by local entropy and global reconstruction residuals are presented to characterize the regional and global detail distortion in TMI, respectively. Besides, a few efficient aesthetic features are extracted to measure the color unnaturalness of TMI. Finally, all extracted features are linked with relevant subjective scores to conduct quality regression via random forest. Experimental results on the ESPL-LIVE HDR database demonstrate that the proposed RSRA-BTMI method is superior to the existing state-of-the-art blind TMI quality assessment methods.
format Online
Article
Text
id pubmed-7517451
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-75174512020-11-09 Blind Tone-Mapped Image Quality Assessment Based on Regional Sparse Response and Aesthetics He, Zhouyan Yu, Mei Chen, Fen Peng, Zongju Xu, Haiyong Song, Yang Entropy (Basel) Article High dynamic range (HDR) images give a strong disposition to capture all parts of natural scene information due to their wider brightness range than traditional low dynamic range (LDR) images. However, to visualize HDR images on common LDR displays, tone mapping operations (TMOs) are extra required, which inevitably lead to visual quality degradation, especially in the bright and dark regions. To evaluate the performance of different TMOs accurately, this paper proposes a blind tone-mapped image quality assessment method based on regional sparse response and aesthetics (RSRA-BTMI) by considering the influences of detail information and color on the human visual system. Specifically, for the detail loss in a tone-mapped image (TMI), multi-dictionaries are first designed for different brightness regions and whole TMI. Then regional sparse atoms aggregated by local entropy and global reconstruction residuals are presented to characterize the regional and global detail distortion in TMI, respectively. Besides, a few efficient aesthetic features are extracted to measure the color unnaturalness of TMI. Finally, all extracted features are linked with relevant subjective scores to conduct quality regression via random forest. Experimental results on the ESPL-LIVE HDR database demonstrate that the proposed RSRA-BTMI method is superior to the existing state-of-the-art blind TMI quality assessment methods. MDPI 2020-07-31 /pmc/articles/PMC7517451/ /pubmed/33286621 http://dx.doi.org/10.3390/e22080850 Text en © 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
He, Zhouyan
Yu, Mei
Chen, Fen
Peng, Zongju
Xu, Haiyong
Song, Yang
Blind Tone-Mapped Image Quality Assessment Based on Regional Sparse Response and Aesthetics
title Blind Tone-Mapped Image Quality Assessment Based on Regional Sparse Response and Aesthetics
title_full Blind Tone-Mapped Image Quality Assessment Based on Regional Sparse Response and Aesthetics
title_fullStr Blind Tone-Mapped Image Quality Assessment Based on Regional Sparse Response and Aesthetics
title_full_unstemmed Blind Tone-Mapped Image Quality Assessment Based on Regional Sparse Response and Aesthetics
title_short Blind Tone-Mapped Image Quality Assessment Based on Regional Sparse Response and Aesthetics
title_sort blind tone-mapped image quality assessment based on regional sparse response and aesthetics
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7517451/
https://www.ncbi.nlm.nih.gov/pubmed/33286621
http://dx.doi.org/10.3390/e22080850
work_keys_str_mv AT hezhouyan blindtonemappedimagequalityassessmentbasedonregionalsparseresponseandaesthetics
AT yumei blindtonemappedimagequalityassessmentbasedonregionalsparseresponseandaesthetics
AT chenfen blindtonemappedimagequalityassessmentbasedonregionalsparseresponseandaesthetics
AT pengzongju blindtonemappedimagequalityassessmentbasedonregionalsparseresponseandaesthetics
AT xuhaiyong blindtonemappedimagequalityassessmentbasedonregionalsparseresponseandaesthetics
AT songyang blindtonemappedimagequalityassessmentbasedonregionalsparseresponseandaesthetics