Cargando…

A Generic Formula and Some Special Cases for the Kullback–Leibler Divergence between Central Multivariate Cauchy Distributions

This paper introduces a closed-form expression for the Kullback–Leibler divergence (KLD) between two central multivariate Cauchy distributions (MCDs) which have been recently used in different signal and image processing applications where non-Gaussian models are needed. In this overview, the MCDs a...

Descripción completa

Detalles Bibliográficos
Autores principales: Bouhlel, Nizar, Rousseau, David
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9222751/
https://www.ncbi.nlm.nih.gov/pubmed/35741558
http://dx.doi.org/10.3390/e24060838
_version_ 1784732947469828096
author Bouhlel, Nizar
Rousseau, David
author_facet Bouhlel, Nizar
Rousseau, David
author_sort Bouhlel, Nizar
collection PubMed
description This paper introduces a closed-form expression for the Kullback–Leibler divergence (KLD) between two central multivariate Cauchy distributions (MCDs) which have been recently used in different signal and image processing applications where non-Gaussian models are needed. In this overview, the MCDs are surveyed and some new results and properties are derived and discussed for the KLD. In addition, the KLD for MCDs is showed to be written as a function of Lauricella D-hypergeometric series [Formula: see text]. Finally, a comparison is made between the Monte Carlo sampling method to approximate the KLD and the numerical value of the closed-form expression of the latter. The approximation of the KLD by Monte Carlo sampling method are shown to converge to its theoretical value when the number of samples goes to the infinity.
format Online
Article
Text
id pubmed-9222751
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-92227512022-06-24 A Generic Formula and Some Special Cases for the Kullback–Leibler Divergence between Central Multivariate Cauchy Distributions Bouhlel, Nizar Rousseau, David Entropy (Basel) Article This paper introduces a closed-form expression for the Kullback–Leibler divergence (KLD) between two central multivariate Cauchy distributions (MCDs) which have been recently used in different signal and image processing applications where non-Gaussian models are needed. In this overview, the MCDs are surveyed and some new results and properties are derived and discussed for the KLD. In addition, the KLD for MCDs is showed to be written as a function of Lauricella D-hypergeometric series [Formula: see text]. Finally, a comparison is made between the Monte Carlo sampling method to approximate the KLD and the numerical value of the closed-form expression of the latter. The approximation of the KLD by Monte Carlo sampling method are shown to converge to its theoretical value when the number of samples goes to the infinity. MDPI 2022-06-17 /pmc/articles/PMC9222751/ /pubmed/35741558 http://dx.doi.org/10.3390/e24060838 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Bouhlel, Nizar
Rousseau, David
A Generic Formula and Some Special Cases for the Kullback–Leibler Divergence between Central Multivariate Cauchy Distributions
title A Generic Formula and Some Special Cases for the Kullback–Leibler Divergence between Central Multivariate Cauchy Distributions
title_full A Generic Formula and Some Special Cases for the Kullback–Leibler Divergence between Central Multivariate Cauchy Distributions
title_fullStr A Generic Formula and Some Special Cases for the Kullback–Leibler Divergence between Central Multivariate Cauchy Distributions
title_full_unstemmed A Generic Formula and Some Special Cases for the Kullback–Leibler Divergence between Central Multivariate Cauchy Distributions
title_short A Generic Formula and Some Special Cases for the Kullback–Leibler Divergence between Central Multivariate Cauchy Distributions
title_sort generic formula and some special cases for the kullback–leibler divergence between central multivariate cauchy distributions
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9222751/
https://www.ncbi.nlm.nih.gov/pubmed/35741558
http://dx.doi.org/10.3390/e24060838
work_keys_str_mv AT bouhlelnizar agenericformulaandsomespecialcasesforthekullbackleiblerdivergencebetweencentralmultivariatecauchydistributions
AT rousseaudavid agenericformulaandsomespecialcasesforthekullbackleiblerdivergencebetweencentralmultivariatecauchydistributions
AT bouhlelnizar genericformulaandsomespecialcasesforthekullbackleiblerdivergencebetweencentralmultivariatecauchydistributions
AT rousseaudavid genericformulaandsomespecialcasesforthekullbackleiblerdivergencebetweencentralmultivariatecauchydistributions