Cargando…
Affine transformations accelerate the training of physics-informed neural networks of a one-dimensional consolidation problem
Physics-informed neural networks (PINNs) leverage data and knowledge about a problem. They provide a nonnumerical pathway to solving partial differential equations by expressing the field solution as an artificial neural network. This approach has been applied successfully to various types of differ...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10511457/ https://www.ncbi.nlm.nih.gov/pubmed/37730743 http://dx.doi.org/10.1038/s41598-023-42141-x |
_version_ | 1785108144722018304 |
---|---|
author | Mandl, Luis Mielke, André Seyedpour, Seyed Morteza Ricken, Tim |
author_facet | Mandl, Luis Mielke, André Seyedpour, Seyed Morteza Ricken, Tim |
author_sort | Mandl, Luis |
collection | PubMed |
description | Physics-informed neural networks (PINNs) leverage data and knowledge about a problem. They provide a nonnumerical pathway to solving partial differential equations by expressing the field solution as an artificial neural network. This approach has been applied successfully to various types of differential equations. A major area of research on PINNs is the application to coupled partial differential equations in particular, and a general breakthrough is still lacking. In coupled equations, the optimization operates in a critical conflict between boundary conditions and the underlying equations, which often requires either many iterations or complex schemes to avoid trivial solutions and to achieve convergence. We provide empirical evidence for the mitigation of bad initial conditioning in PINNs for solving one-dimensional consolidation problems of porous media through the introduction of affine transformations after the classical output layer of artificial neural network architectures, effectively accelerating the training process. These affine physics-informed neural networks (AfPINNs) then produce nontrivial and accurate field solutions even in parameter spaces with diverging orders of magnitude. On average, AfPINNs show the ability to improve the [Formula: see text] relative error by [Formula: see text] after 25,000 epochs for a one-dimensional consolidation problem based on Biot’s theory, and an average improvement by [Formula: see text] with a transfer approach to the theory of porous media. |
format | Online Article Text |
id | pubmed-10511457 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-105114572023-09-22 Affine transformations accelerate the training of physics-informed neural networks of a one-dimensional consolidation problem Mandl, Luis Mielke, André Seyedpour, Seyed Morteza Ricken, Tim Sci Rep Article Physics-informed neural networks (PINNs) leverage data and knowledge about a problem. They provide a nonnumerical pathway to solving partial differential equations by expressing the field solution as an artificial neural network. This approach has been applied successfully to various types of differential equations. A major area of research on PINNs is the application to coupled partial differential equations in particular, and a general breakthrough is still lacking. In coupled equations, the optimization operates in a critical conflict between boundary conditions and the underlying equations, which often requires either many iterations or complex schemes to avoid trivial solutions and to achieve convergence. We provide empirical evidence for the mitigation of bad initial conditioning in PINNs for solving one-dimensional consolidation problems of porous media through the introduction of affine transformations after the classical output layer of artificial neural network architectures, effectively accelerating the training process. These affine physics-informed neural networks (AfPINNs) then produce nontrivial and accurate field solutions even in parameter spaces with diverging orders of magnitude. On average, AfPINNs show the ability to improve the [Formula: see text] relative error by [Formula: see text] after 25,000 epochs for a one-dimensional consolidation problem based on Biot’s theory, and an average improvement by [Formula: see text] with a transfer approach to the theory of porous media. Nature Publishing Group UK 2023-09-20 /pmc/articles/PMC10511457/ /pubmed/37730743 http://dx.doi.org/10.1038/s41598-023-42141-x Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . |
spellingShingle | Article Mandl, Luis Mielke, André Seyedpour, Seyed Morteza Ricken, Tim Affine transformations accelerate the training of physics-informed neural networks of a one-dimensional consolidation problem |
title | Affine transformations accelerate the training of physics-informed neural networks of a one-dimensional consolidation problem |
title_full | Affine transformations accelerate the training of physics-informed neural networks of a one-dimensional consolidation problem |
title_fullStr | Affine transformations accelerate the training of physics-informed neural networks of a one-dimensional consolidation problem |
title_full_unstemmed | Affine transformations accelerate the training of physics-informed neural networks of a one-dimensional consolidation problem |
title_short | Affine transformations accelerate the training of physics-informed neural networks of a one-dimensional consolidation problem |
title_sort | affine transformations accelerate the training of physics-informed neural networks of a one-dimensional consolidation problem |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10511457/ https://www.ncbi.nlm.nih.gov/pubmed/37730743 http://dx.doi.org/10.1038/s41598-023-42141-x |
work_keys_str_mv | AT mandlluis affinetransformationsacceleratethetrainingofphysicsinformedneuralnetworksofaonedimensionalconsolidationproblem AT mielkeandre affinetransformationsacceleratethetrainingofphysicsinformedneuralnetworksofaonedimensionalconsolidationproblem AT seyedpourseyedmorteza affinetransformationsacceleratethetrainingofphysicsinformedneuralnetworksofaonedimensionalconsolidationproblem AT rickentim affinetransformationsacceleratethetrainingofphysicsinformedneuralnetworksofaonedimensionalconsolidationproblem |