Cargando…

Affine transformations accelerate the training of physics-informed neural networks of a one-dimensional consolidation problem

Physics-informed neural networks (PINNs) leverage data and knowledge about a problem. They provide a nonnumerical pathway to solving partial differential equations by expressing the field solution as an artificial neural network. This approach has been applied successfully to various types of differ...

Descripción completa

Detalles Bibliográficos
Autores principales: Mandl, Luis, Mielke, André, Seyedpour, Seyed Morteza, Ricken, Tim
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10511457/
https://www.ncbi.nlm.nih.gov/pubmed/37730743
http://dx.doi.org/10.1038/s41598-023-42141-x
_version_ 1785108144722018304
author Mandl, Luis
Mielke, André
Seyedpour, Seyed Morteza
Ricken, Tim
author_facet Mandl, Luis
Mielke, André
Seyedpour, Seyed Morteza
Ricken, Tim
author_sort Mandl, Luis
collection PubMed
description Physics-informed neural networks (PINNs) leverage data and knowledge about a problem. They provide a nonnumerical pathway to solving partial differential equations by expressing the field solution as an artificial neural network. This approach has been applied successfully to various types of differential equations. A major area of research on PINNs is the application to coupled partial differential equations in particular, and a general breakthrough is still lacking. In coupled equations, the optimization operates in a critical conflict between boundary conditions and the underlying equations, which often requires either many iterations or complex schemes to avoid trivial solutions and to achieve convergence. We provide empirical evidence for the mitigation of bad initial conditioning in PINNs for solving one-dimensional consolidation problems of porous media through the introduction of affine transformations after the classical output layer of artificial neural network architectures, effectively accelerating the training process. These affine physics-informed neural networks (AfPINNs) then produce nontrivial and accurate field solutions even in parameter spaces with diverging orders of magnitude. On average, AfPINNs show the ability to improve the [Formula: see text] relative error by [Formula: see text] after 25,000 epochs for a one-dimensional consolidation problem based on Biot’s theory, and an average improvement by [Formula: see text] with a transfer approach to the theory of porous media.
format Online
Article
Text
id pubmed-10511457
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-105114572023-09-22 Affine transformations accelerate the training of physics-informed neural networks of a one-dimensional consolidation problem Mandl, Luis Mielke, André Seyedpour, Seyed Morteza Ricken, Tim Sci Rep Article Physics-informed neural networks (PINNs) leverage data and knowledge about a problem. They provide a nonnumerical pathway to solving partial differential equations by expressing the field solution as an artificial neural network. This approach has been applied successfully to various types of differential equations. A major area of research on PINNs is the application to coupled partial differential equations in particular, and a general breakthrough is still lacking. In coupled equations, the optimization operates in a critical conflict between boundary conditions and the underlying equations, which often requires either many iterations or complex schemes to avoid trivial solutions and to achieve convergence. We provide empirical evidence for the mitigation of bad initial conditioning in PINNs for solving one-dimensional consolidation problems of porous media through the introduction of affine transformations after the classical output layer of artificial neural network architectures, effectively accelerating the training process. These affine physics-informed neural networks (AfPINNs) then produce nontrivial and accurate field solutions even in parameter spaces with diverging orders of magnitude. On average, AfPINNs show the ability to improve the [Formula: see text] relative error by [Formula: see text] after 25,000 epochs for a one-dimensional consolidation problem based on Biot’s theory, and an average improvement by [Formula: see text] with a transfer approach to the theory of porous media. Nature Publishing Group UK 2023-09-20 /pmc/articles/PMC10511457/ /pubmed/37730743 http://dx.doi.org/10.1038/s41598-023-42141-x Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Mandl, Luis
Mielke, André
Seyedpour, Seyed Morteza
Ricken, Tim
Affine transformations accelerate the training of physics-informed neural networks of a one-dimensional consolidation problem
title Affine transformations accelerate the training of physics-informed neural networks of a one-dimensional consolidation problem
title_full Affine transformations accelerate the training of physics-informed neural networks of a one-dimensional consolidation problem
title_fullStr Affine transformations accelerate the training of physics-informed neural networks of a one-dimensional consolidation problem
title_full_unstemmed Affine transformations accelerate the training of physics-informed neural networks of a one-dimensional consolidation problem
title_short Affine transformations accelerate the training of physics-informed neural networks of a one-dimensional consolidation problem
title_sort affine transformations accelerate the training of physics-informed neural networks of a one-dimensional consolidation problem
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10511457/
https://www.ncbi.nlm.nih.gov/pubmed/37730743
http://dx.doi.org/10.1038/s41598-023-42141-x
work_keys_str_mv AT mandlluis affinetransformationsacceleratethetrainingofphysicsinformedneuralnetworksofaonedimensionalconsolidationproblem
AT mielkeandre affinetransformationsacceleratethetrainingofphysicsinformedneuralnetworksofaonedimensionalconsolidationproblem
AT seyedpourseyedmorteza affinetransformationsacceleratethetrainingofphysicsinformedneuralnetworksofaonedimensionalconsolidationproblem
AT rickentim affinetransformationsacceleratethetrainingofphysicsinformedneuralnetworksofaonedimensionalconsolidationproblem