Cargando…
A Generic Formula and Some Special Cases for the Kullback–Leibler Divergence between Central Multivariate Cauchy Distributions
This paper introduces a closed-form expression for the Kullback–Leibler divergence (KLD) between two central multivariate Cauchy distributions (MCDs) which have been recently used in different signal and image processing applications where non-Gaussian models are needed. In this overview, the MCDs a...
Autores principales: | , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9222751/ https://www.ncbi.nlm.nih.gov/pubmed/35741558 http://dx.doi.org/10.3390/e24060838 |
_version_ | 1784732947469828096 |
---|---|
author | Bouhlel, Nizar Rousseau, David |
author_facet | Bouhlel, Nizar Rousseau, David |
author_sort | Bouhlel, Nizar |
collection | PubMed |
description | This paper introduces a closed-form expression for the Kullback–Leibler divergence (KLD) between two central multivariate Cauchy distributions (MCDs) which have been recently used in different signal and image processing applications where non-Gaussian models are needed. In this overview, the MCDs are surveyed and some new results and properties are derived and discussed for the KLD. In addition, the KLD for MCDs is showed to be written as a function of Lauricella D-hypergeometric series [Formula: see text]. Finally, a comparison is made between the Monte Carlo sampling method to approximate the KLD and the numerical value of the closed-form expression of the latter. The approximation of the KLD by Monte Carlo sampling method are shown to converge to its theoretical value when the number of samples goes to the infinity. |
format | Online Article Text |
id | pubmed-9222751 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-92227512022-06-24 A Generic Formula and Some Special Cases for the Kullback–Leibler Divergence between Central Multivariate Cauchy Distributions Bouhlel, Nizar Rousseau, David Entropy (Basel) Article This paper introduces a closed-form expression for the Kullback–Leibler divergence (KLD) between two central multivariate Cauchy distributions (MCDs) which have been recently used in different signal and image processing applications where non-Gaussian models are needed. In this overview, the MCDs are surveyed and some new results and properties are derived and discussed for the KLD. In addition, the KLD for MCDs is showed to be written as a function of Lauricella D-hypergeometric series [Formula: see text]. Finally, a comparison is made between the Monte Carlo sampling method to approximate the KLD and the numerical value of the closed-form expression of the latter. The approximation of the KLD by Monte Carlo sampling method are shown to converge to its theoretical value when the number of samples goes to the infinity. MDPI 2022-06-17 /pmc/articles/PMC9222751/ /pubmed/35741558 http://dx.doi.org/10.3390/e24060838 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Bouhlel, Nizar Rousseau, David A Generic Formula and Some Special Cases for the Kullback–Leibler Divergence between Central Multivariate Cauchy Distributions |
title | A Generic Formula and Some Special Cases for the Kullback–Leibler Divergence between Central Multivariate Cauchy Distributions |
title_full | A Generic Formula and Some Special Cases for the Kullback–Leibler Divergence between Central Multivariate Cauchy Distributions |
title_fullStr | A Generic Formula and Some Special Cases for the Kullback–Leibler Divergence between Central Multivariate Cauchy Distributions |
title_full_unstemmed | A Generic Formula and Some Special Cases for the Kullback–Leibler Divergence between Central Multivariate Cauchy Distributions |
title_short | A Generic Formula and Some Special Cases for the Kullback–Leibler Divergence between Central Multivariate Cauchy Distributions |
title_sort | generic formula and some special cases for the kullback–leibler divergence between central multivariate cauchy distributions |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9222751/ https://www.ncbi.nlm.nih.gov/pubmed/35741558 http://dx.doi.org/10.3390/e24060838 |
work_keys_str_mv | AT bouhlelnizar agenericformulaandsomespecialcasesforthekullbackleiblerdivergencebetweencentralmultivariatecauchydistributions AT rousseaudavid agenericformulaandsomespecialcasesforthekullbackleiblerdivergencebetweencentralmultivariatecauchydistributions AT bouhlelnizar genericformulaandsomespecialcasesforthekullbackleiblerdivergencebetweencentralmultivariatecauchydistributions AT rousseaudavid genericformulaandsomespecialcasesforthekullbackleiblerdivergencebetweencentralmultivariatecauchydistributions |