Cargando…

Dirichlet Polynomials and Entropy

A Dirichlet polynomial d in one variable [Formula: see text] is a function of the form [Formula: see text] for some [Formula: see text]. We will show how to think of a Dirichlet polynomial as a set-theoretic bundle, and thus as an empirical distribution. We can then consider the Shannon entropy [For...

Descripción completa

Detalles Bibliográficos
Autores principales: Spivak, David I., Hosgood, Timothy
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8392336/
https://www.ncbi.nlm.nih.gov/pubmed/34441225
http://dx.doi.org/10.3390/e23081085
_version_ 1783743479394861056
author Spivak, David I.
Hosgood, Timothy
author_facet Spivak, David I.
Hosgood, Timothy
author_sort Spivak, David I.
collection PubMed
description A Dirichlet polynomial d in one variable [Formula: see text] is a function of the form [Formula: see text] for some [Formula: see text]. We will show how to think of a Dirichlet polynomial as a set-theoretic bundle, and thus as an empirical distribution. We can then consider the Shannon entropy [Formula: see text] of the corresponding probability distribution, and we define its length (or, classically, its perplexity) by [Formula: see text]. On the other hand, we will define a rig homomorphism [Formula: see text] from the rig of Dirichlet polynomials to the so-called rectangle rig, whose underlying set is [Formula: see text] and whose additive structure involves the weighted geometric mean; we write [Formula: see text] , and call the two components area and width (respectively). The main result of this paper is the following: the rectangle-area formula [Formula: see text] holds for any Dirichlet polynomial d. In other words, the entropy of an empirical distribution can be calculated entirely in terms of the homomorphism h applied to its corresponding Dirichlet polynomial. We also show that similar results hold for the cross entropy.
format Online
Article
Text
id pubmed-8392336
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-83923362021-08-28 Dirichlet Polynomials and Entropy Spivak, David I. Hosgood, Timothy Entropy (Basel) Article A Dirichlet polynomial d in one variable [Formula: see text] is a function of the form [Formula: see text] for some [Formula: see text]. We will show how to think of a Dirichlet polynomial as a set-theoretic bundle, and thus as an empirical distribution. We can then consider the Shannon entropy [Formula: see text] of the corresponding probability distribution, and we define its length (or, classically, its perplexity) by [Formula: see text]. On the other hand, we will define a rig homomorphism [Formula: see text] from the rig of Dirichlet polynomials to the so-called rectangle rig, whose underlying set is [Formula: see text] and whose additive structure involves the weighted geometric mean; we write [Formula: see text] , and call the two components area and width (respectively). The main result of this paper is the following: the rectangle-area formula [Formula: see text] holds for any Dirichlet polynomial d. In other words, the entropy of an empirical distribution can be calculated entirely in terms of the homomorphism h applied to its corresponding Dirichlet polynomial. We also show that similar results hold for the cross entropy. MDPI 2021-08-21 /pmc/articles/PMC8392336/ /pubmed/34441225 http://dx.doi.org/10.3390/e23081085 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Spivak, David I.
Hosgood, Timothy
Dirichlet Polynomials and Entropy
title Dirichlet Polynomials and Entropy
title_full Dirichlet Polynomials and Entropy
title_fullStr Dirichlet Polynomials and Entropy
title_full_unstemmed Dirichlet Polynomials and Entropy
title_short Dirichlet Polynomials and Entropy
title_sort dirichlet polynomials and entropy
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8392336/
https://www.ncbi.nlm.nih.gov/pubmed/34441225
http://dx.doi.org/10.3390/e23081085
work_keys_str_mv AT spivakdavidi dirichletpolynomialsandentropy
AT hosgoodtimothy dirichletpolynomialsandentropy