Cargando…

Majorization, Csiszár divergence and Zipf-Mandelbrot law

In this paper we show how the Shannon entropy is connected to the theory of majorization. They are both linked to the measure of disorder in a system. However, the theory of majorization usually gives stronger criteria than the entropic inequalities. We give some generalized results for majorization...

Descripción completa

Detalles Bibliográficos
Autores principales: Latif, Naveed, Pečarić, Ðilda, Pečarić, Josip
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer International Publishing 2017
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5570854/
https://www.ncbi.nlm.nih.gov/pubmed/28904518
http://dx.doi.org/10.1186/s13660-017-1472-2
_version_ 1783259233622425600
author Latif, Naveed
Pečarić, Ðilda
Pečarić, Josip
author_facet Latif, Naveed
Pečarić, Ðilda
Pečarić, Josip
author_sort Latif, Naveed
collection PubMed
description In this paper we show how the Shannon entropy is connected to the theory of majorization. They are both linked to the measure of disorder in a system. However, the theory of majorization usually gives stronger criteria than the entropic inequalities. We give some generalized results for majorization inequality using Csiszár f-divergence. This divergence, applied to some special convex functions, reduces the results for majorization inequality in the form of Shannon entropy and the Kullback-Leibler divergence. We give several applications by using the Zipf-Mandelbrot law.
format Online
Article
Text
id pubmed-5570854
institution National Center for Biotechnology Information
language English
publishDate 2017
publisher Springer International Publishing
record_format MEDLINE/PubMed
spelling pubmed-55708542017-09-11 Majorization, Csiszár divergence and Zipf-Mandelbrot law Latif, Naveed Pečarić, Ðilda Pečarić, Josip J Inequal Appl Research In this paper we show how the Shannon entropy is connected to the theory of majorization. They are both linked to the measure of disorder in a system. However, the theory of majorization usually gives stronger criteria than the entropic inequalities. We give some generalized results for majorization inequality using Csiszár f-divergence. This divergence, applied to some special convex functions, reduces the results for majorization inequality in the form of Shannon entropy and the Kullback-Leibler divergence. We give several applications by using the Zipf-Mandelbrot law. Springer International Publishing 2017-08-24 2017 /pmc/articles/PMC5570854/ /pubmed/28904518 http://dx.doi.org/10.1186/s13660-017-1472-2 Text en © The Author(s) 2017 Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
spellingShingle Research
Latif, Naveed
Pečarić, Ðilda
Pečarić, Josip
Majorization, Csiszár divergence and Zipf-Mandelbrot law
title Majorization, Csiszár divergence and Zipf-Mandelbrot law
title_full Majorization, Csiszár divergence and Zipf-Mandelbrot law
title_fullStr Majorization, Csiszár divergence and Zipf-Mandelbrot law
title_full_unstemmed Majorization, Csiszár divergence and Zipf-Mandelbrot law
title_short Majorization, Csiszár divergence and Zipf-Mandelbrot law
title_sort majorization, csiszár divergence and zipf-mandelbrot law
topic Research
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5570854/
https://www.ncbi.nlm.nih.gov/pubmed/28904518
http://dx.doi.org/10.1186/s13660-017-1472-2
work_keys_str_mv AT latifnaveed majorizationcsiszardivergenceandzipfmandelbrotlaw
AT pecaricðilda majorizationcsiszardivergenceandzipfmandelbrotlaw
AT pecaricjosip majorizationcsiszardivergenceandzipfmandelbrotlaw