Cargando…

Ensemble-SINDy: Robust sparse model discovery in the low-data, high-noise limit, with active learning and control

Sparse model identification enables the discovery of nonlinear dynamical systems purely from data; however, this approach is sensitive to noise, especially in the low-data limit. In this work, we leverage the statistical approach of bootstrap aggregating (bagging) to robustify the sparse identificat...

Descripción completa

Detalles Bibliográficos
Autores principales: Fasel, U., Kutz, J. N., Brunton, B. W., Brunton, S. L.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: The Royal Society 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9006119/
https://www.ncbi.nlm.nih.gov/pubmed/35450025
http://dx.doi.org/10.1098/rspa.2021.0904
_version_ 1784686601604956160
author Fasel, U.
Kutz, J. N.
Brunton, B. W.
Brunton, S. L.
author_facet Fasel, U.
Kutz, J. N.
Brunton, B. W.
Brunton, S. L.
author_sort Fasel, U.
collection PubMed
description Sparse model identification enables the discovery of nonlinear dynamical systems purely from data; however, this approach is sensitive to noise, especially in the low-data limit. In this work, we leverage the statistical approach of bootstrap aggregating (bagging) to robustify the sparse identification of the nonlinear dynamics (SINDy) algorithm. First, an ensemble of SINDy models is identified from subsets of limited and noisy data. The aggregate model statistics are then used to produce inclusion probabilities of the candidate functions, which enables uncertainty quantification and probabilistic forecasts. We apply this ensemble-SINDy (E-SINDy) algorithm to several synthetic and real-world datasets and demonstrate substantial improvements to the accuracy and robustness of model discovery from extremely noisy and limited data. For example, E-SINDy uncovers partial differential equations models from data with more than twice as much measurement noise as has been previously reported. Similarly, E-SINDy learns the Lotka Volterra dynamics from remarkably limited data of yearly lynx and hare pelts collected from 1900 to 1920. E-SINDy is computationally efficient, with similar scaling as standard SINDy. Finally, we show that ensemble statistics from E-SINDy can be exploited for active learning and improved model predictive control.
format Online
Article
Text
id pubmed-9006119
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher The Royal Society
record_format MEDLINE/PubMed
spelling pubmed-90061192022-04-20 Ensemble-SINDy: Robust sparse model discovery in the low-data, high-noise limit, with active learning and control Fasel, U. Kutz, J. N. Brunton, B. W. Brunton, S. L. Proc Math Phys Eng Sci Research Articles Sparse model identification enables the discovery of nonlinear dynamical systems purely from data; however, this approach is sensitive to noise, especially in the low-data limit. In this work, we leverage the statistical approach of bootstrap aggregating (bagging) to robustify the sparse identification of the nonlinear dynamics (SINDy) algorithm. First, an ensemble of SINDy models is identified from subsets of limited and noisy data. The aggregate model statistics are then used to produce inclusion probabilities of the candidate functions, which enables uncertainty quantification and probabilistic forecasts. We apply this ensemble-SINDy (E-SINDy) algorithm to several synthetic and real-world datasets and demonstrate substantial improvements to the accuracy and robustness of model discovery from extremely noisy and limited data. For example, E-SINDy uncovers partial differential equations models from data with more than twice as much measurement noise as has been previously reported. Similarly, E-SINDy learns the Lotka Volterra dynamics from remarkably limited data of yearly lynx and hare pelts collected from 1900 to 1920. E-SINDy is computationally efficient, with similar scaling as standard SINDy. Finally, we show that ensemble statistics from E-SINDy can be exploited for active learning and improved model predictive control. The Royal Society 2022-04 2022-04-13 /pmc/articles/PMC9006119/ /pubmed/35450025 http://dx.doi.org/10.1098/rspa.2021.0904 Text en © 2022 The Authors. https://creativecommons.org/licenses/by/4.0/Published by the Royal Society under the terms of the Creative Commons Attribution License http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, provided the original author and source are credited.
spellingShingle Research Articles
Fasel, U.
Kutz, J. N.
Brunton, B. W.
Brunton, S. L.
Ensemble-SINDy: Robust sparse model discovery in the low-data, high-noise limit, with active learning and control
title Ensemble-SINDy: Robust sparse model discovery in the low-data, high-noise limit, with active learning and control
title_full Ensemble-SINDy: Robust sparse model discovery in the low-data, high-noise limit, with active learning and control
title_fullStr Ensemble-SINDy: Robust sparse model discovery in the low-data, high-noise limit, with active learning and control
title_full_unstemmed Ensemble-SINDy: Robust sparse model discovery in the low-data, high-noise limit, with active learning and control
title_short Ensemble-SINDy: Robust sparse model discovery in the low-data, high-noise limit, with active learning and control
title_sort ensemble-sindy: robust sparse model discovery in the low-data, high-noise limit, with active learning and control
topic Research Articles
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9006119/
https://www.ncbi.nlm.nih.gov/pubmed/35450025
http://dx.doi.org/10.1098/rspa.2021.0904
work_keys_str_mv AT faselu ensemblesindyrobustsparsemodeldiscoveryinthelowdatahighnoiselimitwithactivelearningandcontrol
AT kutzjn ensemblesindyrobustsparsemodeldiscoveryinthelowdatahighnoiselimitwithactivelearningandcontrol
AT bruntonbw ensemblesindyrobustsparsemodeldiscoveryinthelowdatahighnoiselimitwithactivelearningandcontrol
AT bruntonsl ensemblesindyrobustsparsemodeldiscoveryinthelowdatahighnoiselimitwithactivelearningandcontrol