Cargando…
Information Geometric Duality of ϕ-Deformed Exponential Families
In the world of generalized entropies—which, for example, play a role in physical systems with sub- and super-exponential phase space growth per degree of freedom—there are two ways for implementing constraints in the maximum entropy principle: linear and escort constraints. Both appear naturally in...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2019
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7514596/ https://www.ncbi.nlm.nih.gov/pubmed/33266828 http://dx.doi.org/10.3390/e21020112 |
_version_ | 1783586624596082688 |
---|---|
author | Korbel, Jan Hanel, Rudolf Thurner, Stefan |
author_facet | Korbel, Jan Hanel, Rudolf Thurner, Stefan |
author_sort | Korbel, Jan |
collection | PubMed |
description | In the world of generalized entropies—which, for example, play a role in physical systems with sub- and super-exponential phase space growth per degree of freedom—there are two ways for implementing constraints in the maximum entropy principle: linear and escort constraints. Both appear naturally in different contexts. Linear constraints appear, e.g., in physical systems, when additional information about the system is available through higher moments. Escort distributions appear naturally in the context of multifractals and information geometry. It was shown recently that there exists a fundamental duality that relates both approaches on the basis of the corresponding deformed logarithms (deformed-log duality). Here, we show that there exists another duality that arises in the context of information geometry, relating the Fisher information of [Formula: see text]-deformed exponential families that correspond to linear constraints (as studied by J.Naudts) to those that are based on escort constraints (as studied by S.-I. Amari). We explicitly demonstrate this information geometric duality for the case of [Formula: see text]-entropy, which covers all situations that are compatible with the first three Shannon–Khinchin axioms and that include Shannon, Tsallis, Anteneodo–Plastino entropy, and many more as special cases. Finally, we discuss the relation between the deformed-log duality and the information geometric duality and mention that the escort distributions arising in these two dualities are generally different and only coincide for the case of the Tsallis deformation. |
format | Online Article Text |
id | pubmed-7514596 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2019 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-75145962020-11-09 Information Geometric Duality of ϕ-Deformed Exponential Families Korbel, Jan Hanel, Rudolf Thurner, Stefan Entropy (Basel) Article In the world of generalized entropies—which, for example, play a role in physical systems with sub- and super-exponential phase space growth per degree of freedom—there are two ways for implementing constraints in the maximum entropy principle: linear and escort constraints. Both appear naturally in different contexts. Linear constraints appear, e.g., in physical systems, when additional information about the system is available through higher moments. Escort distributions appear naturally in the context of multifractals and information geometry. It was shown recently that there exists a fundamental duality that relates both approaches on the basis of the corresponding deformed logarithms (deformed-log duality). Here, we show that there exists another duality that arises in the context of information geometry, relating the Fisher information of [Formula: see text]-deformed exponential families that correspond to linear constraints (as studied by J.Naudts) to those that are based on escort constraints (as studied by S.-I. Amari). We explicitly demonstrate this information geometric duality for the case of [Formula: see text]-entropy, which covers all situations that are compatible with the first three Shannon–Khinchin axioms and that include Shannon, Tsallis, Anteneodo–Plastino entropy, and many more as special cases. Finally, we discuss the relation between the deformed-log duality and the information geometric duality and mention that the escort distributions arising in these two dualities are generally different and only coincide for the case of the Tsallis deformation. MDPI 2019-01-24 /pmc/articles/PMC7514596/ /pubmed/33266828 http://dx.doi.org/10.3390/e21020112 Text en © 2019 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Korbel, Jan Hanel, Rudolf Thurner, Stefan Information Geometric Duality of ϕ-Deformed Exponential Families |
title | Information Geometric Duality of ϕ-Deformed Exponential Families |
title_full | Information Geometric Duality of ϕ-Deformed Exponential Families |
title_fullStr | Information Geometric Duality of ϕ-Deformed Exponential Families |
title_full_unstemmed | Information Geometric Duality of ϕ-Deformed Exponential Families |
title_short | Information Geometric Duality of ϕ-Deformed Exponential Families |
title_sort | information geometric duality of ϕ-deformed exponential families |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7514596/ https://www.ncbi.nlm.nih.gov/pubmed/33266828 http://dx.doi.org/10.3390/e21020112 |
work_keys_str_mv | AT korbeljan informationgeometricdualityofphdeformedexponentialfamilies AT hanelrudolf informationgeometricdualityofphdeformedexponentialfamilies AT thurnerstefan informationgeometricdualityofphdeformedexponentialfamilies |