Cargando…

From calibration to parameter learning: Harnessing the scaling effects of big data in geoscientific modeling

The behaviors and skills of models in many geosciences (e.g., hydrology and ecosystem sciences) strongly depend on spatially-varying parameters that need calibration. A well-calibrated model can reasonably propagate information from observations to unobserved variables via model physics, but traditi...

Descripción completa

Detalles Bibliográficos
Autores principales: Tsai, Wen-Ping, Feng, Dapeng, Pan, Ming, Beck, Hylke, Lawson, Kathryn, Yang, Yuan, Liu, Jiangtao, Shen, Chaopeng
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8514470/
https://www.ncbi.nlm.nih.gov/pubmed/34645796
http://dx.doi.org/10.1038/s41467-021-26107-z
_version_ 1784583393785151488
author Tsai, Wen-Ping
Feng, Dapeng
Pan, Ming
Beck, Hylke
Lawson, Kathryn
Yang, Yuan
Liu, Jiangtao
Shen, Chaopeng
author_facet Tsai, Wen-Ping
Feng, Dapeng
Pan, Ming
Beck, Hylke
Lawson, Kathryn
Yang, Yuan
Liu, Jiangtao
Shen, Chaopeng
author_sort Tsai, Wen-Ping
collection PubMed
description The behaviors and skills of models in many geosciences (e.g., hydrology and ecosystem sciences) strongly depend on spatially-varying parameters that need calibration. A well-calibrated model can reasonably propagate information from observations to unobserved variables via model physics, but traditional calibration is highly inefficient and results in non-unique solutions. Here we propose a novel differentiable parameter learning (dPL) framework that efficiently learns a global mapping between inputs (and optionally responses) and parameters. Crucially, dPL exhibits beneficial scaling curves not previously demonstrated to geoscientists: as training data increases, dPL achieves better performance, more physical coherence, and better generalizability (across space and uncalibrated variables), all with orders-of-magnitude lower computational cost. We demonstrate examples that learned from soil moisture and streamflow, where dPL drastically outperformed existing evolutionary and regionalization methods, or required only ~12.5% of the training data to achieve similar performance. The generic scheme promotes the integration of deep learning and process-based models, without mandating reimplementation.
format Online
Article
Text
id pubmed-8514470
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-85144702021-10-29 From calibration to parameter learning: Harnessing the scaling effects of big data in geoscientific modeling Tsai, Wen-Ping Feng, Dapeng Pan, Ming Beck, Hylke Lawson, Kathryn Yang, Yuan Liu, Jiangtao Shen, Chaopeng Nat Commun Article The behaviors and skills of models in many geosciences (e.g., hydrology and ecosystem sciences) strongly depend on spatially-varying parameters that need calibration. A well-calibrated model can reasonably propagate information from observations to unobserved variables via model physics, but traditional calibration is highly inefficient and results in non-unique solutions. Here we propose a novel differentiable parameter learning (dPL) framework that efficiently learns a global mapping between inputs (and optionally responses) and parameters. Crucially, dPL exhibits beneficial scaling curves not previously demonstrated to geoscientists: as training data increases, dPL achieves better performance, more physical coherence, and better generalizability (across space and uncalibrated variables), all with orders-of-magnitude lower computational cost. We demonstrate examples that learned from soil moisture and streamflow, where dPL drastically outperformed existing evolutionary and regionalization methods, or required only ~12.5% of the training data to achieve similar performance. The generic scheme promotes the integration of deep learning and process-based models, without mandating reimplementation. Nature Publishing Group UK 2021-10-13 /pmc/articles/PMC8514470/ /pubmed/34645796 http://dx.doi.org/10.1038/s41467-021-26107-z Text en © The Author(s) 2021 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Tsai, Wen-Ping
Feng, Dapeng
Pan, Ming
Beck, Hylke
Lawson, Kathryn
Yang, Yuan
Liu, Jiangtao
Shen, Chaopeng
From calibration to parameter learning: Harnessing the scaling effects of big data in geoscientific modeling
title From calibration to parameter learning: Harnessing the scaling effects of big data in geoscientific modeling
title_full From calibration to parameter learning: Harnessing the scaling effects of big data in geoscientific modeling
title_fullStr From calibration to parameter learning: Harnessing the scaling effects of big data in geoscientific modeling
title_full_unstemmed From calibration to parameter learning: Harnessing the scaling effects of big data in geoscientific modeling
title_short From calibration to parameter learning: Harnessing the scaling effects of big data in geoscientific modeling
title_sort from calibration to parameter learning: harnessing the scaling effects of big data in geoscientific modeling
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8514470/
https://www.ncbi.nlm.nih.gov/pubmed/34645796
http://dx.doi.org/10.1038/s41467-021-26107-z
work_keys_str_mv AT tsaiwenping fromcalibrationtoparameterlearningharnessingthescalingeffectsofbigdataingeoscientificmodeling
AT fengdapeng fromcalibrationtoparameterlearningharnessingthescalingeffectsofbigdataingeoscientificmodeling
AT panming fromcalibrationtoparameterlearningharnessingthescalingeffectsofbigdataingeoscientificmodeling
AT beckhylke fromcalibrationtoparameterlearningharnessingthescalingeffectsofbigdataingeoscientificmodeling
AT lawsonkathryn fromcalibrationtoparameterlearningharnessingthescalingeffectsofbigdataingeoscientificmodeling
AT yangyuan fromcalibrationtoparameterlearningharnessingthescalingeffectsofbigdataingeoscientificmodeling
AT liujiangtao fromcalibrationtoparameterlearningharnessingthescalingeffectsofbigdataingeoscientificmodeling
AT shenchaopeng fromcalibrationtoparameterlearningharnessingthescalingeffectsofbigdataingeoscientificmodeling