Cargando…
Reduced order modeling for flow and transport problems with Barlow Twins self-supervised learning
We propose a unified data-driven reduced order model (ROM) that bridges the performance gap between linear and nonlinear manifold approaches. Deep learning ROM (DL-ROM) using deep-convolutional autoencoders (DC–AE) has been shown to capture nonlinear solution manifolds but fails to perform adequatel...
Autores principales: | , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9712510/ https://www.ncbi.nlm.nih.gov/pubmed/36450820 http://dx.doi.org/10.1038/s41598-022-24545-3 |
_version_ | 1784841803486199808 |
---|---|
author | Kadeethum, Teeratorn Ballarin, Francesco O’Malley, Daniel Choi, Youngsoo Bouklas, Nikolaos Yoon, Hongkyu |
author_facet | Kadeethum, Teeratorn Ballarin, Francesco O’Malley, Daniel Choi, Youngsoo Bouklas, Nikolaos Yoon, Hongkyu |
author_sort | Kadeethum, Teeratorn |
collection | PubMed |
description | We propose a unified data-driven reduced order model (ROM) that bridges the performance gap between linear and nonlinear manifold approaches. Deep learning ROM (DL-ROM) using deep-convolutional autoencoders (DC–AE) has been shown to capture nonlinear solution manifolds but fails to perform adequately when linear subspace approaches such as proper orthogonal decomposition (POD) would be optimal. Besides, most DL-ROM models rely on convolutional layers, which might limit its application to only a structured mesh. The proposed framework in this study relies on the combination of an autoencoder (AE) and Barlow Twins (BT) self-supervised learning, where BT maximizes the information content of the embedding with the latent space through a joint embedding architecture. Through a series of benchmark problems of natural convection in porous media, BT–AE performs better than the previous DL-ROM framework by providing comparable results to POD-based approaches for problems where the solution lies within a linear subspace as well as DL-ROM autoencoder-based techniques where the solution lies on a nonlinear manifold; consequently, bridges the gap between linear and nonlinear reduced manifolds. We illustrate that a proficient construction of the latent space is key to achieving these results, enabling us to map these latent spaces using regression models. The proposed framework achieves a relative error of 2% on average and 12% in the worst-case scenario (i.e., the training data is small, but the parameter space is large.). We also show that our framework provides a speed-up of [Formula: see text] times, in the best case, and [Formula: see text] times on average compared to a finite element solver. Furthermore, this BT–AE framework can operate on unstructured meshes, which provides flexibility in its application to standard numerical solvers, on-site measurements, experimental data, or a combination of these sources. |
format | Online Article Text |
id | pubmed-9712510 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-97125102022-12-02 Reduced order modeling for flow and transport problems with Barlow Twins self-supervised learning Kadeethum, Teeratorn Ballarin, Francesco O’Malley, Daniel Choi, Youngsoo Bouklas, Nikolaos Yoon, Hongkyu Sci Rep Article We propose a unified data-driven reduced order model (ROM) that bridges the performance gap between linear and nonlinear manifold approaches. Deep learning ROM (DL-ROM) using deep-convolutional autoencoders (DC–AE) has been shown to capture nonlinear solution manifolds but fails to perform adequately when linear subspace approaches such as proper orthogonal decomposition (POD) would be optimal. Besides, most DL-ROM models rely on convolutional layers, which might limit its application to only a structured mesh. The proposed framework in this study relies on the combination of an autoencoder (AE) and Barlow Twins (BT) self-supervised learning, where BT maximizes the information content of the embedding with the latent space through a joint embedding architecture. Through a series of benchmark problems of natural convection in porous media, BT–AE performs better than the previous DL-ROM framework by providing comparable results to POD-based approaches for problems where the solution lies within a linear subspace as well as DL-ROM autoencoder-based techniques where the solution lies on a nonlinear manifold; consequently, bridges the gap between linear and nonlinear reduced manifolds. We illustrate that a proficient construction of the latent space is key to achieving these results, enabling us to map these latent spaces using regression models. The proposed framework achieves a relative error of 2% on average and 12% in the worst-case scenario (i.e., the training data is small, but the parameter space is large.). We also show that our framework provides a speed-up of [Formula: see text] times, in the best case, and [Formula: see text] times on average compared to a finite element solver. Furthermore, this BT–AE framework can operate on unstructured meshes, which provides flexibility in its application to standard numerical solvers, on-site measurements, experimental data, or a combination of these sources. Nature Publishing Group UK 2022-11-30 /pmc/articles/PMC9712510/ /pubmed/36450820 http://dx.doi.org/10.1038/s41598-022-24545-3 Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . |
spellingShingle | Article Kadeethum, Teeratorn Ballarin, Francesco O’Malley, Daniel Choi, Youngsoo Bouklas, Nikolaos Yoon, Hongkyu Reduced order modeling for flow and transport problems with Barlow Twins self-supervised learning |
title | Reduced order modeling for flow and transport problems with Barlow Twins self-supervised learning |
title_full | Reduced order modeling for flow and transport problems with Barlow Twins self-supervised learning |
title_fullStr | Reduced order modeling for flow and transport problems with Barlow Twins self-supervised learning |
title_full_unstemmed | Reduced order modeling for flow and transport problems with Barlow Twins self-supervised learning |
title_short | Reduced order modeling for flow and transport problems with Barlow Twins self-supervised learning |
title_sort | reduced order modeling for flow and transport problems with barlow twins self-supervised learning |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9712510/ https://www.ncbi.nlm.nih.gov/pubmed/36450820 http://dx.doi.org/10.1038/s41598-022-24545-3 |
work_keys_str_mv | AT kadeethumteeratorn reducedordermodelingforflowandtransportproblemswithbarlowtwinsselfsupervisedlearning AT ballarinfrancesco reducedordermodelingforflowandtransportproblemswithbarlowtwinsselfsupervisedlearning AT omalleydaniel reducedordermodelingforflowandtransportproblemswithbarlowtwinsselfsupervisedlearning AT choiyoungsoo reducedordermodelingforflowandtransportproblemswithbarlowtwinsselfsupervisedlearning AT bouklasnikolaos reducedordermodelingforflowandtransportproblemswithbarlowtwinsselfsupervisedlearning AT yoonhongkyu reducedordermodelingforflowandtransportproblemswithbarlowtwinsselfsupervisedlearning |