Cargando…
Majorization, Csiszár divergence and Zipf-Mandelbrot law
In this paper we show how the Shannon entropy is connected to the theory of majorization. They are both linked to the measure of disorder in a system. However, the theory of majorization usually gives stronger criteria than the entropic inequalities. We give some generalized results for majorization...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Springer International Publishing
2017
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5570854/ https://www.ncbi.nlm.nih.gov/pubmed/28904518 http://dx.doi.org/10.1186/s13660-017-1472-2 |
_version_ | 1783259233622425600 |
---|---|
author | Latif, Naveed Pečarić, Ðilda Pečarić, Josip |
author_facet | Latif, Naveed Pečarić, Ðilda Pečarić, Josip |
author_sort | Latif, Naveed |
collection | PubMed |
description | In this paper we show how the Shannon entropy is connected to the theory of majorization. They are both linked to the measure of disorder in a system. However, the theory of majorization usually gives stronger criteria than the entropic inequalities. We give some generalized results for majorization inequality using Csiszár f-divergence. This divergence, applied to some special convex functions, reduces the results for majorization inequality in the form of Shannon entropy and the Kullback-Leibler divergence. We give several applications by using the Zipf-Mandelbrot law. |
format | Online Article Text |
id | pubmed-5570854 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2017 |
publisher | Springer International Publishing |
record_format | MEDLINE/PubMed |
spelling | pubmed-55708542017-09-11 Majorization, Csiszár divergence and Zipf-Mandelbrot law Latif, Naveed Pečarić, Ðilda Pečarić, Josip J Inequal Appl Research In this paper we show how the Shannon entropy is connected to the theory of majorization. They are both linked to the measure of disorder in a system. However, the theory of majorization usually gives stronger criteria than the entropic inequalities. We give some generalized results for majorization inequality using Csiszár f-divergence. This divergence, applied to some special convex functions, reduces the results for majorization inequality in the form of Shannon entropy and the Kullback-Leibler divergence. We give several applications by using the Zipf-Mandelbrot law. Springer International Publishing 2017-08-24 2017 /pmc/articles/PMC5570854/ /pubmed/28904518 http://dx.doi.org/10.1186/s13660-017-1472-2 Text en © The Author(s) 2017 Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. |
spellingShingle | Research Latif, Naveed Pečarić, Ðilda Pečarić, Josip Majorization, Csiszár divergence and Zipf-Mandelbrot law |
title | Majorization, Csiszár divergence and Zipf-Mandelbrot law |
title_full | Majorization, Csiszár divergence and Zipf-Mandelbrot law |
title_fullStr | Majorization, Csiszár divergence and Zipf-Mandelbrot law |
title_full_unstemmed | Majorization, Csiszár divergence and Zipf-Mandelbrot law |
title_short | Majorization, Csiszár divergence and Zipf-Mandelbrot law |
title_sort | majorization, csiszár divergence and zipf-mandelbrot law |
topic | Research |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5570854/ https://www.ncbi.nlm.nih.gov/pubmed/28904518 http://dx.doi.org/10.1186/s13660-017-1472-2 |
work_keys_str_mv | AT latifnaveed majorizationcsiszardivergenceandzipfmandelbrotlaw AT pecaricðilda majorizationcsiszardivergenceandzipfmandelbrotlaw AT pecaricjosip majorizationcsiszardivergenceandzipfmandelbrotlaw |