Cargando…

New Estimations for Shannon and Zipf–Mandelbrot Entropies

The main purpose of this paper is to find new estimations for the Shannon and Zipf–Mandelbrot entropies. We apply some refinements of the Jensen inequality to obtain different bounds for these entropies. Initially, we use a precise convex function in the refinement of the Jensen inequality and then...

Descripción completa

Detalles Bibliográficos
Autores principales: Adil Khan, Muhammad, Al-sahwi, Zaid Mohammad, Chu, Yu-Ming
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2018
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7513133/
https://www.ncbi.nlm.nih.gov/pubmed/33265697
http://dx.doi.org/10.3390/e20080608
_version_ 1783586317980925952
author Adil Khan, Muhammad
Al-sahwi, Zaid Mohammad
Chu, Yu-Ming
author_facet Adil Khan, Muhammad
Al-sahwi, Zaid Mohammad
Chu, Yu-Ming
author_sort Adil Khan, Muhammad
collection PubMed
description The main purpose of this paper is to find new estimations for the Shannon and Zipf–Mandelbrot entropies. We apply some refinements of the Jensen inequality to obtain different bounds for these entropies. Initially, we use a precise convex function in the refinement of the Jensen inequality and then tamper the weight and domain of the function to obtain general bounds for the Shannon entropy (SE). As particular cases of these general bounds, we derive some bounds for the Shannon entropy (SE) which are, in fact, the applications of some other well-known refinements of the Jensen inequality. Finally, we derive different estimations for the Zipf–Mandelbrot entropy (ZME) by using the new bounds of the Shannon entropy for the Zipf–Mandelbrot law (ZML). We also discuss particular cases and the bounds related to two different parametrics of the Zipf–Mandelbrot entropy. At the end of the paper we give some applications in linguistics.
format Online
Article
Text
id pubmed-7513133
institution National Center for Biotechnology Information
language English
publishDate 2018
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-75131332020-11-09 New Estimations for Shannon and Zipf–Mandelbrot Entropies Adil Khan, Muhammad Al-sahwi, Zaid Mohammad Chu, Yu-Ming Entropy (Basel) Article The main purpose of this paper is to find new estimations for the Shannon and Zipf–Mandelbrot entropies. We apply some refinements of the Jensen inequality to obtain different bounds for these entropies. Initially, we use a precise convex function in the refinement of the Jensen inequality and then tamper the weight and domain of the function to obtain general bounds for the Shannon entropy (SE). As particular cases of these general bounds, we derive some bounds for the Shannon entropy (SE) which are, in fact, the applications of some other well-known refinements of the Jensen inequality. Finally, we derive different estimations for the Zipf–Mandelbrot entropy (ZME) by using the new bounds of the Shannon entropy for the Zipf–Mandelbrot law (ZML). We also discuss particular cases and the bounds related to two different parametrics of the Zipf–Mandelbrot entropy. At the end of the paper we give some applications in linguistics. MDPI 2018-08-16 /pmc/articles/PMC7513133/ /pubmed/33265697 http://dx.doi.org/10.3390/e20080608 Text en © 2018 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Adil Khan, Muhammad
Al-sahwi, Zaid Mohammad
Chu, Yu-Ming
New Estimations for Shannon and Zipf–Mandelbrot Entropies
title New Estimations for Shannon and Zipf–Mandelbrot Entropies
title_full New Estimations for Shannon and Zipf–Mandelbrot Entropies
title_fullStr New Estimations for Shannon and Zipf–Mandelbrot Entropies
title_full_unstemmed New Estimations for Shannon and Zipf–Mandelbrot Entropies
title_short New Estimations for Shannon and Zipf–Mandelbrot Entropies
title_sort new estimations for shannon and zipf–mandelbrot entropies
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7513133/
https://www.ncbi.nlm.nih.gov/pubmed/33265697
http://dx.doi.org/10.3390/e20080608
work_keys_str_mv AT adilkhanmuhammad newestimationsforshannonandzipfmandelbrotentropies
AT alsahwizaidmohammad newestimationsforshannonandzipfmandelbrotentropies
AT chuyuming newestimationsforshannonandzipfmandelbrotentropies