Cargando…

Nonreference Image Quality Evaluation Algorithm Based on Wavelet Convolutional Neural Network and Information Entropy

The image quality evaluation method, based on the convolutional neural network (CNN), achieved good evaluation performance. However, this method can easily lead the visual quality of image sub-blocks to change with the spatial position after the image is processed by various distortions. Consequentl...

Descripción completa

Detalles Bibliográficos
Autores principales: Liu, Jinhua, Xu, Mulian, Xu, Xinye, Huang, Yuanyuan
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2019
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7514374/
http://dx.doi.org/10.3390/e21111070
_version_ 1783586573381533696
author Liu, Jinhua
Xu, Mulian
Xu, Xinye
Huang, Yuanyuan
author_facet Liu, Jinhua
Xu, Mulian
Xu, Xinye
Huang, Yuanyuan
author_sort Liu, Jinhua
collection PubMed
description The image quality evaluation method, based on the convolutional neural network (CNN), achieved good evaluation performance. However, this method can easily lead the visual quality of image sub-blocks to change with the spatial position after the image is processed by various distortions. Consequently, the visual quality of the entire image is difficult to reflect objectively. On this basis, this study combines wavelet transform and CNN method to propose an image quality evaluation method based on wavelet CNN. The low-frequency, horizontal, vertical, and diagonal sub-band images decomposed by wavelet transform are selected as the inputs of convolution neural network. The feature information in multiple directions is extracted by convolution neural network. Then, the information entropy of each sub-band image is calculated and used as the weight of each sub-band image quality. Finally, the quality evaluation values of four sub-band images are weighted and fused to obtain the visual quality values of the entire image. Experimental results show that the proposed method gains advantage from the global and local information of the image, thereby further improving its effectiveness and generalization.
format Online
Article
Text
id pubmed-7514374
institution National Center for Biotechnology Information
language English
publishDate 2019
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-75143742020-11-09 Nonreference Image Quality Evaluation Algorithm Based on Wavelet Convolutional Neural Network and Information Entropy Liu, Jinhua Xu, Mulian Xu, Xinye Huang, Yuanyuan Entropy (Basel) Article The image quality evaluation method, based on the convolutional neural network (CNN), achieved good evaluation performance. However, this method can easily lead the visual quality of image sub-blocks to change with the spatial position after the image is processed by various distortions. Consequently, the visual quality of the entire image is difficult to reflect objectively. On this basis, this study combines wavelet transform and CNN method to propose an image quality evaluation method based on wavelet CNN. The low-frequency, horizontal, vertical, and diagonal sub-band images decomposed by wavelet transform are selected as the inputs of convolution neural network. The feature information in multiple directions is extracted by convolution neural network. Then, the information entropy of each sub-band image is calculated and used as the weight of each sub-band image quality. Finally, the quality evaluation values of four sub-band images are weighted and fused to obtain the visual quality values of the entire image. Experimental results show that the proposed method gains advantage from the global and local information of the image, thereby further improving its effectiveness and generalization. MDPI 2019-10-31 /pmc/articles/PMC7514374/ http://dx.doi.org/10.3390/e21111070 Text en © 2019 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Liu, Jinhua
Xu, Mulian
Xu, Xinye
Huang, Yuanyuan
Nonreference Image Quality Evaluation Algorithm Based on Wavelet Convolutional Neural Network and Information Entropy
title Nonreference Image Quality Evaluation Algorithm Based on Wavelet Convolutional Neural Network and Information Entropy
title_full Nonreference Image Quality Evaluation Algorithm Based on Wavelet Convolutional Neural Network and Information Entropy
title_fullStr Nonreference Image Quality Evaluation Algorithm Based on Wavelet Convolutional Neural Network and Information Entropy
title_full_unstemmed Nonreference Image Quality Evaluation Algorithm Based on Wavelet Convolutional Neural Network and Information Entropy
title_short Nonreference Image Quality Evaluation Algorithm Based on Wavelet Convolutional Neural Network and Information Entropy
title_sort nonreference image quality evaluation algorithm based on wavelet convolutional neural network and information entropy
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7514374/
http://dx.doi.org/10.3390/e21111070
work_keys_str_mv AT liujinhua nonreferenceimagequalityevaluationalgorithmbasedonwaveletconvolutionalneuralnetworkandinformationentropy
AT xumulian nonreferenceimagequalityevaluationalgorithmbasedonwaveletconvolutionalneuralnetworkandinformationentropy
AT xuxinye nonreferenceimagequalityevaluationalgorithmbasedonwaveletconvolutionalneuralnetworkandinformationentropy
AT huangyuanyuan nonreferenceimagequalityevaluationalgorithmbasedonwaveletconvolutionalneuralnetworkandinformationentropy