Cargando…

Physics-informed neural ODE (PINODE): embedding physics into models using collocation points

Building reduced-order models (ROMs) is essential for efficient forecasting and control of complex dynamical systems. Recently, autoencoder-based methods for building such models have gained significant traction, but their demand for data limits their use when the data is scarce and expensive. We pr...

Descripción completa

Detalles Bibliográficos
Autores principales: Sholokhov, Aleksei, Liu, Yuying, Mansour, Hassan, Nabi, Saleh
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10287651/
https://www.ncbi.nlm.nih.gov/pubmed/37349375
http://dx.doi.org/10.1038/s41598-023-36799-6
_version_ 1785061917824385024
author Sholokhov, Aleksei
Liu, Yuying
Mansour, Hassan
Nabi, Saleh
author_facet Sholokhov, Aleksei
Liu, Yuying
Mansour, Hassan
Nabi, Saleh
author_sort Sholokhov, Aleksei
collection PubMed
description Building reduced-order models (ROMs) is essential for efficient forecasting and control of complex dynamical systems. Recently, autoencoder-based methods for building such models have gained significant traction, but their demand for data limits their use when the data is scarce and expensive. We propose aiding a model’s training with the knowledge of physics using a collocation-based physics-informed loss term. Our innovation builds on ideas from classical collocation methods of numerical analysis to embed knowledge from a known equation into the latent-space dynamics of a ROM. We show that the addition of our physics-informed loss allows for exceptional data supply strategies that improves the performance of ROMs in data-scarce settings, where training high-quality data-driven models is impossible. Namely, for a problem of modeling a high-dimensional nonlinear PDE, our experiments show [Formula: see text] 5 performance gains, measured by prediction error, in a low-data regime, [Formula: see text] 10 performance gains in tasks of high-noise learning, [Formula: see text] 100 gains in the efficiency of utilizing the latent-space dimension, and [Formula: see text] 200 gains in tasks of far-out out-of-distribution forecasting relative to purely data-driven models. These improvements pave the way for broader adoption of network-based physics-informed ROMs in compressive sensing and control applications.
format Online
Article
Text
id pubmed-10287651
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-102876512023-06-24 Physics-informed neural ODE (PINODE): embedding physics into models using collocation points Sholokhov, Aleksei Liu, Yuying Mansour, Hassan Nabi, Saleh Sci Rep Article Building reduced-order models (ROMs) is essential for efficient forecasting and control of complex dynamical systems. Recently, autoencoder-based methods for building such models have gained significant traction, but their demand for data limits their use when the data is scarce and expensive. We propose aiding a model’s training with the knowledge of physics using a collocation-based physics-informed loss term. Our innovation builds on ideas from classical collocation methods of numerical analysis to embed knowledge from a known equation into the latent-space dynamics of a ROM. We show that the addition of our physics-informed loss allows for exceptional data supply strategies that improves the performance of ROMs in data-scarce settings, where training high-quality data-driven models is impossible. Namely, for a problem of modeling a high-dimensional nonlinear PDE, our experiments show [Formula: see text] 5 performance gains, measured by prediction error, in a low-data regime, [Formula: see text] 10 performance gains in tasks of high-noise learning, [Formula: see text] 100 gains in the efficiency of utilizing the latent-space dimension, and [Formula: see text] 200 gains in tasks of far-out out-of-distribution forecasting relative to purely data-driven models. These improvements pave the way for broader adoption of network-based physics-informed ROMs in compressive sensing and control applications. Nature Publishing Group UK 2023-06-22 /pmc/articles/PMC10287651/ /pubmed/37349375 http://dx.doi.org/10.1038/s41598-023-36799-6 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Sholokhov, Aleksei
Liu, Yuying
Mansour, Hassan
Nabi, Saleh
Physics-informed neural ODE (PINODE): embedding physics into models using collocation points
title Physics-informed neural ODE (PINODE): embedding physics into models using collocation points
title_full Physics-informed neural ODE (PINODE): embedding physics into models using collocation points
title_fullStr Physics-informed neural ODE (PINODE): embedding physics into models using collocation points
title_full_unstemmed Physics-informed neural ODE (PINODE): embedding physics into models using collocation points
title_short Physics-informed neural ODE (PINODE): embedding physics into models using collocation points
title_sort physics-informed neural ode (pinode): embedding physics into models using collocation points
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10287651/
https://www.ncbi.nlm.nih.gov/pubmed/37349375
http://dx.doi.org/10.1038/s41598-023-36799-6
work_keys_str_mv AT sholokhovaleksei physicsinformedneuralodepinodeembeddingphysicsintomodelsusingcollocationpoints
AT liuyuying physicsinformedneuralodepinodeembeddingphysicsintomodelsusingcollocationpoints
AT mansourhassan physicsinformedneuralodepinodeembeddingphysicsintomodelsusingcollocationpoints
AT nabisaleh physicsinformedneuralodepinodeembeddingphysicsintomodelsusingcollocationpoints