Cargando…

Reduced order modeling for flow and transport problems with Barlow Twins self-supervised learning

We propose a unified data-driven reduced order model (ROM) that bridges the performance gap between linear and nonlinear manifold approaches. Deep learning ROM (DL-ROM) using deep-convolutional autoencoders (DC–AE) has been shown to capture nonlinear solution manifolds but fails to perform adequatel...

Descripción completa

Detalles Bibliográficos
Autores principales: Kadeethum, Teeratorn, Ballarin, Francesco, O’Malley, Daniel, Choi, Youngsoo, Bouklas, Nikolaos, Yoon, Hongkyu
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9712510/
https://www.ncbi.nlm.nih.gov/pubmed/36450820
http://dx.doi.org/10.1038/s41598-022-24545-3
_version_ 1784841803486199808
author Kadeethum, Teeratorn
Ballarin, Francesco
O’Malley, Daniel
Choi, Youngsoo
Bouklas, Nikolaos
Yoon, Hongkyu
author_facet Kadeethum, Teeratorn
Ballarin, Francesco
O’Malley, Daniel
Choi, Youngsoo
Bouklas, Nikolaos
Yoon, Hongkyu
author_sort Kadeethum, Teeratorn
collection PubMed
description We propose a unified data-driven reduced order model (ROM) that bridges the performance gap between linear and nonlinear manifold approaches. Deep learning ROM (DL-ROM) using deep-convolutional autoencoders (DC–AE) has been shown to capture nonlinear solution manifolds but fails to perform adequately when linear subspace approaches such as proper orthogonal decomposition (POD) would be optimal. Besides, most DL-ROM models rely on convolutional layers, which might limit its application to only a structured mesh. The proposed framework in this study relies on the combination of an autoencoder (AE) and Barlow Twins (BT) self-supervised learning, where BT maximizes the information content of the embedding with the latent space through a joint embedding architecture. Through a series of benchmark problems of natural convection in porous media, BT–AE performs better than the previous DL-ROM framework by providing comparable results to POD-based approaches for problems where the solution lies within a linear subspace as well as DL-ROM autoencoder-based techniques where the solution lies on a nonlinear manifold; consequently, bridges the gap between linear and nonlinear reduced manifolds. We illustrate that a proficient construction of the latent space is key to achieving these results, enabling us to map these latent spaces using regression models. The proposed framework achieves a relative error of 2% on average and 12% in the worst-case scenario (i.e., the training data is small, but the parameter space is large.). We also show that our framework provides a speed-up of [Formula: see text] times, in the best case, and [Formula: see text] times on average compared to a finite element solver. Furthermore, this BT–AE framework can operate on unstructured meshes, which provides flexibility in its application to standard numerical solvers, on-site measurements, experimental data, or a combination of these sources.
format Online
Article
Text
id pubmed-9712510
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-97125102022-12-02 Reduced order modeling for flow and transport problems with Barlow Twins self-supervised learning Kadeethum, Teeratorn Ballarin, Francesco O’Malley, Daniel Choi, Youngsoo Bouklas, Nikolaos Yoon, Hongkyu Sci Rep Article We propose a unified data-driven reduced order model (ROM) that bridges the performance gap between linear and nonlinear manifold approaches. Deep learning ROM (DL-ROM) using deep-convolutional autoencoders (DC–AE) has been shown to capture nonlinear solution manifolds but fails to perform adequately when linear subspace approaches such as proper orthogonal decomposition (POD) would be optimal. Besides, most DL-ROM models rely on convolutional layers, which might limit its application to only a structured mesh. The proposed framework in this study relies on the combination of an autoencoder (AE) and Barlow Twins (BT) self-supervised learning, where BT maximizes the information content of the embedding with the latent space through a joint embedding architecture. Through a series of benchmark problems of natural convection in porous media, BT–AE performs better than the previous DL-ROM framework by providing comparable results to POD-based approaches for problems where the solution lies within a linear subspace as well as DL-ROM autoencoder-based techniques where the solution lies on a nonlinear manifold; consequently, bridges the gap between linear and nonlinear reduced manifolds. We illustrate that a proficient construction of the latent space is key to achieving these results, enabling us to map these latent spaces using regression models. The proposed framework achieves a relative error of 2% on average and 12% in the worst-case scenario (i.e., the training data is small, but the parameter space is large.). We also show that our framework provides a speed-up of [Formula: see text] times, in the best case, and [Formula: see text] times on average compared to a finite element solver. Furthermore, this BT–AE framework can operate on unstructured meshes, which provides flexibility in its application to standard numerical solvers, on-site measurements, experimental data, or a combination of these sources. Nature Publishing Group UK 2022-11-30 /pmc/articles/PMC9712510/ /pubmed/36450820 http://dx.doi.org/10.1038/s41598-022-24545-3 Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Kadeethum, Teeratorn
Ballarin, Francesco
O’Malley, Daniel
Choi, Youngsoo
Bouklas, Nikolaos
Yoon, Hongkyu
Reduced order modeling for flow and transport problems with Barlow Twins self-supervised learning
title Reduced order modeling for flow and transport problems with Barlow Twins self-supervised learning
title_full Reduced order modeling for flow and transport problems with Barlow Twins self-supervised learning
title_fullStr Reduced order modeling for flow and transport problems with Barlow Twins self-supervised learning
title_full_unstemmed Reduced order modeling for flow and transport problems with Barlow Twins self-supervised learning
title_short Reduced order modeling for flow and transport problems with Barlow Twins self-supervised learning
title_sort reduced order modeling for flow and transport problems with barlow twins self-supervised learning
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9712510/
https://www.ncbi.nlm.nih.gov/pubmed/36450820
http://dx.doi.org/10.1038/s41598-022-24545-3
work_keys_str_mv AT kadeethumteeratorn reducedordermodelingforflowandtransportproblemswithbarlowtwinsselfsupervisedlearning
AT ballarinfrancesco reducedordermodelingforflowandtransportproblemswithbarlowtwinsselfsupervisedlearning
AT omalleydaniel reducedordermodelingforflowandtransportproblemswithbarlowtwinsselfsupervisedlearning
AT choiyoungsoo reducedordermodelingforflowandtransportproblemswithbarlowtwinsselfsupervisedlearning
AT bouklasnikolaos reducedordermodelingforflowandtransportproblemswithbarlowtwinsselfsupervisedlearning
AT yoonhongkyu reducedordermodelingforflowandtransportproblemswithbarlowtwinsselfsupervisedlearning