Cargando…
Physics-informed neural ODE (PINODE): embedding physics into models using collocation points
Building reduced-order models (ROMs) is essential for efficient forecasting and control of complex dynamical systems. Recently, autoencoder-based methods for building such models have gained significant traction, but their demand for data limits their use when the data is scarce and expensive. We pr...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10287651/ https://www.ncbi.nlm.nih.gov/pubmed/37349375 http://dx.doi.org/10.1038/s41598-023-36799-6 |
_version_ | 1785061917824385024 |
---|---|
author | Sholokhov, Aleksei Liu, Yuying Mansour, Hassan Nabi, Saleh |
author_facet | Sholokhov, Aleksei Liu, Yuying Mansour, Hassan Nabi, Saleh |
author_sort | Sholokhov, Aleksei |
collection | PubMed |
description | Building reduced-order models (ROMs) is essential for efficient forecasting and control of complex dynamical systems. Recently, autoencoder-based methods for building such models have gained significant traction, but their demand for data limits their use when the data is scarce and expensive. We propose aiding a model’s training with the knowledge of physics using a collocation-based physics-informed loss term. Our innovation builds on ideas from classical collocation methods of numerical analysis to embed knowledge from a known equation into the latent-space dynamics of a ROM. We show that the addition of our physics-informed loss allows for exceptional data supply strategies that improves the performance of ROMs in data-scarce settings, where training high-quality data-driven models is impossible. Namely, for a problem of modeling a high-dimensional nonlinear PDE, our experiments show [Formula: see text] 5 performance gains, measured by prediction error, in a low-data regime, [Formula: see text] 10 performance gains in tasks of high-noise learning, [Formula: see text] 100 gains in the efficiency of utilizing the latent-space dimension, and [Formula: see text] 200 gains in tasks of far-out out-of-distribution forecasting relative to purely data-driven models. These improvements pave the way for broader adoption of network-based physics-informed ROMs in compressive sensing and control applications. |
format | Online Article Text |
id | pubmed-10287651 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-102876512023-06-24 Physics-informed neural ODE (PINODE): embedding physics into models using collocation points Sholokhov, Aleksei Liu, Yuying Mansour, Hassan Nabi, Saleh Sci Rep Article Building reduced-order models (ROMs) is essential for efficient forecasting and control of complex dynamical systems. Recently, autoencoder-based methods for building such models have gained significant traction, but their demand for data limits their use when the data is scarce and expensive. We propose aiding a model’s training with the knowledge of physics using a collocation-based physics-informed loss term. Our innovation builds on ideas from classical collocation methods of numerical analysis to embed knowledge from a known equation into the latent-space dynamics of a ROM. We show that the addition of our physics-informed loss allows for exceptional data supply strategies that improves the performance of ROMs in data-scarce settings, where training high-quality data-driven models is impossible. Namely, for a problem of modeling a high-dimensional nonlinear PDE, our experiments show [Formula: see text] 5 performance gains, measured by prediction error, in a low-data regime, [Formula: see text] 10 performance gains in tasks of high-noise learning, [Formula: see text] 100 gains in the efficiency of utilizing the latent-space dimension, and [Formula: see text] 200 gains in tasks of far-out out-of-distribution forecasting relative to purely data-driven models. These improvements pave the way for broader adoption of network-based physics-informed ROMs in compressive sensing and control applications. Nature Publishing Group UK 2023-06-22 /pmc/articles/PMC10287651/ /pubmed/37349375 http://dx.doi.org/10.1038/s41598-023-36799-6 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . |
spellingShingle | Article Sholokhov, Aleksei Liu, Yuying Mansour, Hassan Nabi, Saleh Physics-informed neural ODE (PINODE): embedding physics into models using collocation points |
title | Physics-informed neural ODE (PINODE): embedding physics into models using collocation points |
title_full | Physics-informed neural ODE (PINODE): embedding physics into models using collocation points |
title_fullStr | Physics-informed neural ODE (PINODE): embedding physics into models using collocation points |
title_full_unstemmed | Physics-informed neural ODE (PINODE): embedding physics into models using collocation points |
title_short | Physics-informed neural ODE (PINODE): embedding physics into models using collocation points |
title_sort | physics-informed neural ode (pinode): embedding physics into models using collocation points |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10287651/ https://www.ncbi.nlm.nih.gov/pubmed/37349375 http://dx.doi.org/10.1038/s41598-023-36799-6 |
work_keys_str_mv | AT sholokhovaleksei physicsinformedneuralodepinodeembeddingphysicsintomodelsusingcollocationpoints AT liuyuying physicsinformedneuralodepinodeembeddingphysicsintomodelsusingcollocationpoints AT mansourhassan physicsinformedneuralodepinodeembeddingphysicsintomodelsusingcollocationpoints AT nabisaleh physicsinformedneuralodepinodeembeddingphysicsintomodelsusingcollocationpoints |