Cargando…

Information Geometric Duality of ϕ-Deformed Exponential Families

In the world of generalized entropies—which, for example, play a role in physical systems with sub- and super-exponential phase space growth per degree of freedom—there are two ways for implementing constraints in the maximum entropy principle: linear and escort constraints. Both appear naturally in...

Descripción completa

Detalles Bibliográficos
Autores principales: Korbel, Jan, Hanel, Rudolf, Thurner, Stefan
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2019
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7514596/
https://www.ncbi.nlm.nih.gov/pubmed/33266828
http://dx.doi.org/10.3390/e21020112
_version_ 1783586624596082688
author Korbel, Jan
Hanel, Rudolf
Thurner, Stefan
author_facet Korbel, Jan
Hanel, Rudolf
Thurner, Stefan
author_sort Korbel, Jan
collection PubMed
description In the world of generalized entropies—which, for example, play a role in physical systems with sub- and super-exponential phase space growth per degree of freedom—there are two ways for implementing constraints in the maximum entropy principle: linear and escort constraints. Both appear naturally in different contexts. Linear constraints appear, e.g., in physical systems, when additional information about the system is available through higher moments. Escort distributions appear naturally in the context of multifractals and information geometry. It was shown recently that there exists a fundamental duality that relates both approaches on the basis of the corresponding deformed logarithms (deformed-log duality). Here, we show that there exists another duality that arises in the context of information geometry, relating the Fisher information of [Formula: see text]-deformed exponential families that correspond to linear constraints (as studied by J.Naudts) to those that are based on escort constraints (as studied by S.-I. Amari). We explicitly demonstrate this information geometric duality for the case of [Formula: see text]-entropy, which covers all situations that are compatible with the first three Shannon–Khinchin axioms and that include Shannon, Tsallis, Anteneodo–Plastino entropy, and many more as special cases. Finally, we discuss the relation between the deformed-log duality and the information geometric duality and mention that the escort distributions arising in these two dualities are generally different and only coincide for the case of the Tsallis deformation.
format Online
Article
Text
id pubmed-7514596
institution National Center for Biotechnology Information
language English
publishDate 2019
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-75145962020-11-09 Information Geometric Duality of ϕ-Deformed Exponential Families Korbel, Jan Hanel, Rudolf Thurner, Stefan Entropy (Basel) Article In the world of generalized entropies—which, for example, play a role in physical systems with sub- and super-exponential phase space growth per degree of freedom—there are two ways for implementing constraints in the maximum entropy principle: linear and escort constraints. Both appear naturally in different contexts. Linear constraints appear, e.g., in physical systems, when additional information about the system is available through higher moments. Escort distributions appear naturally in the context of multifractals and information geometry. It was shown recently that there exists a fundamental duality that relates both approaches on the basis of the corresponding deformed logarithms (deformed-log duality). Here, we show that there exists another duality that arises in the context of information geometry, relating the Fisher information of [Formula: see text]-deformed exponential families that correspond to linear constraints (as studied by J.Naudts) to those that are based on escort constraints (as studied by S.-I. Amari). We explicitly demonstrate this information geometric duality for the case of [Formula: see text]-entropy, which covers all situations that are compatible with the first three Shannon–Khinchin axioms and that include Shannon, Tsallis, Anteneodo–Plastino entropy, and many more as special cases. Finally, we discuss the relation between the deformed-log duality and the information geometric duality and mention that the escort distributions arising in these two dualities are generally different and only coincide for the case of the Tsallis deformation. MDPI 2019-01-24 /pmc/articles/PMC7514596/ /pubmed/33266828 http://dx.doi.org/10.3390/e21020112 Text en © 2019 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Korbel, Jan
Hanel, Rudolf
Thurner, Stefan
Information Geometric Duality of ϕ-Deformed Exponential Families
title Information Geometric Duality of ϕ-Deformed Exponential Families
title_full Information Geometric Duality of ϕ-Deformed Exponential Families
title_fullStr Information Geometric Duality of ϕ-Deformed Exponential Families
title_full_unstemmed Information Geometric Duality of ϕ-Deformed Exponential Families
title_short Information Geometric Duality of ϕ-Deformed Exponential Families
title_sort information geometric duality of ϕ-deformed exponential families
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7514596/
https://www.ncbi.nlm.nih.gov/pubmed/33266828
http://dx.doi.org/10.3390/e21020112
work_keys_str_mv AT korbeljan informationgeometricdualityofphdeformedexponentialfamilies
AT hanelrudolf informationgeometricdualityofphdeformedexponentialfamilies
AT thurnerstefan informationgeometricdualityofphdeformedexponentialfamilies