Cargando…

Information Transfer in Linear Multivariate Processes Assessed through Penalized Regression Techniques: Validation and Application to Physiological Networks

The framework of information dynamics allows the dissection of the information processed in a network of multiple interacting dynamical systems into meaningful elements of computation that quantify the information generated in a target system, stored in it, transferred to it from one or more source...

Descripción completa

Detalles Bibliográficos
Autores principales: Antonacci, Yuri, Astolfi, Laura, Nollo, Giandomenico, Faes, Luca
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7517272/
https://www.ncbi.nlm.nih.gov/pubmed/33286504
http://dx.doi.org/10.3390/e22070732
_version_ 1783587191917641728
author Antonacci, Yuri
Astolfi, Laura
Nollo, Giandomenico
Faes, Luca
author_facet Antonacci, Yuri
Astolfi, Laura
Nollo, Giandomenico
Faes, Luca
author_sort Antonacci, Yuri
collection PubMed
description The framework of information dynamics allows the dissection of the information processed in a network of multiple interacting dynamical systems into meaningful elements of computation that quantify the information generated in a target system, stored in it, transferred to it from one or more source systems, and modified in a synergistic or redundant way. The concepts of information transfer and modification have been recently formulated in the context of linear parametric modeling of vector stochastic processes, linking them to the notion of Granger causality and providing efficient tools for their computation based on the state–space (SS) representation of vector autoregressive (VAR) models. Despite their high computational reliability these tools still suffer from estimation problems which emerge, in the case of low ratio between data points available and the number of time series, when VAR identification is performed via the standard ordinary least squares (OLS). In this work we propose to replace the OLS with penalized regression performed through the Least Absolute Shrinkage and Selection Operator (LASSO), prior to computation of the measures of information transfer and information modification. First, simulating networks of several coupled Gaussian systems with complex interactions, we show that the LASSO regression allows, also in conditions of data paucity, to accurately reconstruct both the underlying network topology and the expected patterns of information transfer. Then we apply the proposed VAR-SS-LASSO approach to a challenging application context, i.e., the study of the physiological network of brain and peripheral interactions probed in humans under different conditions of rest and mental stress. Our results, which document the possibility to extract physiologically plausible patterns of interaction between the cardiovascular, respiratory and brain wave amplitudes, open the way to the use of our new analysis tools to explore the emerging field of Network Physiology in several practical applications.
format Online
Article
Text
id pubmed-7517272
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-75172722020-11-09 Information Transfer in Linear Multivariate Processes Assessed through Penalized Regression Techniques: Validation and Application to Physiological Networks Antonacci, Yuri Astolfi, Laura Nollo, Giandomenico Faes, Luca Entropy (Basel) Article The framework of information dynamics allows the dissection of the information processed in a network of multiple interacting dynamical systems into meaningful elements of computation that quantify the information generated in a target system, stored in it, transferred to it from one or more source systems, and modified in a synergistic or redundant way. The concepts of information transfer and modification have been recently formulated in the context of linear parametric modeling of vector stochastic processes, linking them to the notion of Granger causality and providing efficient tools for their computation based on the state–space (SS) representation of vector autoregressive (VAR) models. Despite their high computational reliability these tools still suffer from estimation problems which emerge, in the case of low ratio between data points available and the number of time series, when VAR identification is performed via the standard ordinary least squares (OLS). In this work we propose to replace the OLS with penalized regression performed through the Least Absolute Shrinkage and Selection Operator (LASSO), prior to computation of the measures of information transfer and information modification. First, simulating networks of several coupled Gaussian systems with complex interactions, we show that the LASSO regression allows, also in conditions of data paucity, to accurately reconstruct both the underlying network topology and the expected patterns of information transfer. Then we apply the proposed VAR-SS-LASSO approach to a challenging application context, i.e., the study of the physiological network of brain and peripheral interactions probed in humans under different conditions of rest and mental stress. Our results, which document the possibility to extract physiologically plausible patterns of interaction between the cardiovascular, respiratory and brain wave amplitudes, open the way to the use of our new analysis tools to explore the emerging field of Network Physiology in several practical applications. MDPI 2020-07-01 /pmc/articles/PMC7517272/ /pubmed/33286504 http://dx.doi.org/10.3390/e22070732 Text en © 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Antonacci, Yuri
Astolfi, Laura
Nollo, Giandomenico
Faes, Luca
Information Transfer in Linear Multivariate Processes Assessed through Penalized Regression Techniques: Validation and Application to Physiological Networks
title Information Transfer in Linear Multivariate Processes Assessed through Penalized Regression Techniques: Validation and Application to Physiological Networks
title_full Information Transfer in Linear Multivariate Processes Assessed through Penalized Regression Techniques: Validation and Application to Physiological Networks
title_fullStr Information Transfer in Linear Multivariate Processes Assessed through Penalized Regression Techniques: Validation and Application to Physiological Networks
title_full_unstemmed Information Transfer in Linear Multivariate Processes Assessed through Penalized Regression Techniques: Validation and Application to Physiological Networks
title_short Information Transfer in Linear Multivariate Processes Assessed through Penalized Regression Techniques: Validation and Application to Physiological Networks
title_sort information transfer in linear multivariate processes assessed through penalized regression techniques: validation and application to physiological networks
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7517272/
https://www.ncbi.nlm.nih.gov/pubmed/33286504
http://dx.doi.org/10.3390/e22070732
work_keys_str_mv AT antonacciyuri informationtransferinlinearmultivariateprocessesassessedthroughpenalizedregressiontechniquesvalidationandapplicationtophysiologicalnetworks
AT astolfilaura informationtransferinlinearmultivariateprocessesassessedthroughpenalizedregressiontechniquesvalidationandapplicationtophysiologicalnetworks
AT nollogiandomenico informationtransferinlinearmultivariateprocessesassessedthroughpenalizedregressiontechniquesvalidationandapplicationtophysiologicalnetworks
AT faesluca informationtransferinlinearmultivariateprocessesassessedthroughpenalizedregressiontechniquesvalidationandapplicationtophysiologicalnetworks