Cargando…

Comparing Information Metrics for a Coupled Ornstein–Uhlenbeck Process

It is often the case when studying complex dynamical systems that a statistical formulation can provide the greatest insight into the underlying dynamics. When discussing the behavior of such a system which is evolving in time, it is useful to have the notion of a metric between two given states. A...

Descripción completa

Detalles Bibliográficos
Autores principales: Heseltine, James, Kim, Eun-jin
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2019
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7515303/
https://www.ncbi.nlm.nih.gov/pubmed/33267488
http://dx.doi.org/10.3390/e21080775
_version_ 1783586786177449984
author Heseltine, James
Kim, Eun-jin
author_facet Heseltine, James
Kim, Eun-jin
author_sort Heseltine, James
collection PubMed
description It is often the case when studying complex dynamical systems that a statistical formulation can provide the greatest insight into the underlying dynamics. When discussing the behavior of such a system which is evolving in time, it is useful to have the notion of a metric between two given states. A popular measure of information change in a system under perturbation has been the relative entropy of the states, as this notion allows us to quantify the difference between states of a system at different times. In this paper, we investigate the relaxation problem given by a single and coupled Ornstein–Uhlenbeck (O-U) process and compare the information length with entropy-based metrics (relative entropy, Jensen divergence) as well as others. By measuring the total information length in the long time limit, we show that it is only the information length that preserves the linear geometry of the O-U process. In the coupled O-U process, the information length is shown to be capable of detecting changes in both components of the system even when other metrics would detect almost nothing in one of the components. We show in detail that the information length is sensitive to the evolution of subsystems.
format Online
Article
Text
id pubmed-7515303
institution National Center for Biotechnology Information
language English
publishDate 2019
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-75153032020-11-09 Comparing Information Metrics for a Coupled Ornstein–Uhlenbeck Process Heseltine, James Kim, Eun-jin Entropy (Basel) Article It is often the case when studying complex dynamical systems that a statistical formulation can provide the greatest insight into the underlying dynamics. When discussing the behavior of such a system which is evolving in time, it is useful to have the notion of a metric between two given states. A popular measure of information change in a system under perturbation has been the relative entropy of the states, as this notion allows us to quantify the difference between states of a system at different times. In this paper, we investigate the relaxation problem given by a single and coupled Ornstein–Uhlenbeck (O-U) process and compare the information length with entropy-based metrics (relative entropy, Jensen divergence) as well as others. By measuring the total information length in the long time limit, we show that it is only the information length that preserves the linear geometry of the O-U process. In the coupled O-U process, the information length is shown to be capable of detecting changes in both components of the system even when other metrics would detect almost nothing in one of the components. We show in detail that the information length is sensitive to the evolution of subsystems. MDPI 2019-08-08 /pmc/articles/PMC7515303/ /pubmed/33267488 http://dx.doi.org/10.3390/e21080775 Text en © 2019 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Heseltine, James
Kim, Eun-jin
Comparing Information Metrics for a Coupled Ornstein–Uhlenbeck Process
title Comparing Information Metrics for a Coupled Ornstein–Uhlenbeck Process
title_full Comparing Information Metrics for a Coupled Ornstein–Uhlenbeck Process
title_fullStr Comparing Information Metrics for a Coupled Ornstein–Uhlenbeck Process
title_full_unstemmed Comparing Information Metrics for a Coupled Ornstein–Uhlenbeck Process
title_short Comparing Information Metrics for a Coupled Ornstein–Uhlenbeck Process
title_sort comparing information metrics for a coupled ornstein–uhlenbeck process
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7515303/
https://www.ncbi.nlm.nih.gov/pubmed/33267488
http://dx.doi.org/10.3390/e21080775
work_keys_str_mv AT heseltinejames comparinginformationmetricsforacoupledornsteinuhlenbeckprocess
AT kimeunjin comparinginformationmetricsforacoupledornsteinuhlenbeckprocess