Cargando…
Dirichlet Polynomials and Entropy
A Dirichlet polynomial d in one variable [Formula: see text] is a function of the form [Formula: see text] for some [Formula: see text]. We will show how to think of a Dirichlet polynomial as a set-theoretic bundle, and thus as an empirical distribution. We can then consider the Shannon entropy [For...
Autores principales: | , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8392336/ https://www.ncbi.nlm.nih.gov/pubmed/34441225 http://dx.doi.org/10.3390/e23081085 |
_version_ | 1783743479394861056 |
---|---|
author | Spivak, David I. Hosgood, Timothy |
author_facet | Spivak, David I. Hosgood, Timothy |
author_sort | Spivak, David I. |
collection | PubMed |
description | A Dirichlet polynomial d in one variable [Formula: see text] is a function of the form [Formula: see text] for some [Formula: see text]. We will show how to think of a Dirichlet polynomial as a set-theoretic bundle, and thus as an empirical distribution. We can then consider the Shannon entropy [Formula: see text] of the corresponding probability distribution, and we define its length (or, classically, its perplexity) by [Formula: see text]. On the other hand, we will define a rig homomorphism [Formula: see text] from the rig of Dirichlet polynomials to the so-called rectangle rig, whose underlying set is [Formula: see text] and whose additive structure involves the weighted geometric mean; we write [Formula: see text] , and call the two components area and width (respectively). The main result of this paper is the following: the rectangle-area formula [Formula: see text] holds for any Dirichlet polynomial d. In other words, the entropy of an empirical distribution can be calculated entirely in terms of the homomorphism h applied to its corresponding Dirichlet polynomial. We also show that similar results hold for the cross entropy. |
format | Online Article Text |
id | pubmed-8392336 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-83923362021-08-28 Dirichlet Polynomials and Entropy Spivak, David I. Hosgood, Timothy Entropy (Basel) Article A Dirichlet polynomial d in one variable [Formula: see text] is a function of the form [Formula: see text] for some [Formula: see text]. We will show how to think of a Dirichlet polynomial as a set-theoretic bundle, and thus as an empirical distribution. We can then consider the Shannon entropy [Formula: see text] of the corresponding probability distribution, and we define its length (or, classically, its perplexity) by [Formula: see text]. On the other hand, we will define a rig homomorphism [Formula: see text] from the rig of Dirichlet polynomials to the so-called rectangle rig, whose underlying set is [Formula: see text] and whose additive structure involves the weighted geometric mean; we write [Formula: see text] , and call the two components area and width (respectively). The main result of this paper is the following: the rectangle-area formula [Formula: see text] holds for any Dirichlet polynomial d. In other words, the entropy of an empirical distribution can be calculated entirely in terms of the homomorphism h applied to its corresponding Dirichlet polynomial. We also show that similar results hold for the cross entropy. MDPI 2021-08-21 /pmc/articles/PMC8392336/ /pubmed/34441225 http://dx.doi.org/10.3390/e23081085 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Spivak, David I. Hosgood, Timothy Dirichlet Polynomials and Entropy |
title | Dirichlet Polynomials and Entropy |
title_full | Dirichlet Polynomials and Entropy |
title_fullStr | Dirichlet Polynomials and Entropy |
title_full_unstemmed | Dirichlet Polynomials and Entropy |
title_short | Dirichlet Polynomials and Entropy |
title_sort | dirichlet polynomials and entropy |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8392336/ https://www.ncbi.nlm.nih.gov/pubmed/34441225 http://dx.doi.org/10.3390/e23081085 |
work_keys_str_mv | AT spivakdavidi dirichletpolynomialsandentropy AT hosgoodtimothy dirichletpolynomialsandentropy |