Cargando…
Prediction uncertainty assessment of a systems biology model requires a sample of the full probability distribution of its parameters
Multi-parameter models in systems biology are typically ‘sloppy’: some parameters or combinations of parameters may be hard to estimate from data, whereas others are not. One might expect that parameter uncertainty automatically leads to uncertain predictions, but this is not the case. We illustrate...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
PeerJ Inc.
2014
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4081139/ https://www.ncbi.nlm.nih.gov/pubmed/25024907 http://dx.doi.org/10.7717/peerj.433 |
_version_ | 1782324075025137664 |
---|---|
author | van Mourik, Simon ter Braak, Cajo Stigter, Hans Molenaar, Jaap |
author_facet | van Mourik, Simon ter Braak, Cajo Stigter, Hans Molenaar, Jaap |
author_sort | van Mourik, Simon |
collection | PubMed |
description | Multi-parameter models in systems biology are typically ‘sloppy’: some parameters or combinations of parameters may be hard to estimate from data, whereas others are not. One might expect that parameter uncertainty automatically leads to uncertain predictions, but this is not the case. We illustrate this by showing that the prediction uncertainty of each of six sloppy models varies enormously among different predictions. Statistical approximations of parameter uncertainty may lead to dramatic errors in prediction uncertainty estimation. We argue that prediction uncertainty assessment must therefore be performed on a per-prediction basis using a full computational uncertainty analysis. In practice this is feasible by providing a model with a sample or ensemble representing the distribution of its parameters. Within a Bayesian framework, such a sample may be generated by a Markov Chain Monte Carlo (MCMC) algorithm that infers the parameter distribution based on experimental data. Matlab code for generating the sample (with the Differential Evolution Markov Chain sampler) and the subsequent uncertainty analysis using such a sample, is supplied as Supplemental Information. |
format | Online Article Text |
id | pubmed-4081139 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2014 |
publisher | PeerJ Inc. |
record_format | MEDLINE/PubMed |
spelling | pubmed-40811392014-07-14 Prediction uncertainty assessment of a systems biology model requires a sample of the full probability distribution of its parameters van Mourik, Simon ter Braak, Cajo Stigter, Hans Molenaar, Jaap PeerJ Bioinformatics Multi-parameter models in systems biology are typically ‘sloppy’: some parameters or combinations of parameters may be hard to estimate from data, whereas others are not. One might expect that parameter uncertainty automatically leads to uncertain predictions, but this is not the case. We illustrate this by showing that the prediction uncertainty of each of six sloppy models varies enormously among different predictions. Statistical approximations of parameter uncertainty may lead to dramatic errors in prediction uncertainty estimation. We argue that prediction uncertainty assessment must therefore be performed on a per-prediction basis using a full computational uncertainty analysis. In practice this is feasible by providing a model with a sample or ensemble representing the distribution of its parameters. Within a Bayesian framework, such a sample may be generated by a Markov Chain Monte Carlo (MCMC) algorithm that infers the parameter distribution based on experimental data. Matlab code for generating the sample (with the Differential Evolution Markov Chain sampler) and the subsequent uncertainty analysis using such a sample, is supplied as Supplemental Information. PeerJ Inc. 2014-06-17 /pmc/articles/PMC4081139/ /pubmed/25024907 http://dx.doi.org/10.7717/peerj.433 Text en © 2014 van Mourik et al. http://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, reproduction and adaptation in any medium and for any purpose provided that it is properly attributed. For attribution, the original author(s), title, publication source (PeerJ) and either DOI or URL of the article must be cited. |
spellingShingle | Bioinformatics van Mourik, Simon ter Braak, Cajo Stigter, Hans Molenaar, Jaap Prediction uncertainty assessment of a systems biology model requires a sample of the full probability distribution of its parameters |
title | Prediction uncertainty assessment of a systems biology model requires a sample of the full probability distribution of its parameters |
title_full | Prediction uncertainty assessment of a systems biology model requires a sample of the full probability distribution of its parameters |
title_fullStr | Prediction uncertainty assessment of a systems biology model requires a sample of the full probability distribution of its parameters |
title_full_unstemmed | Prediction uncertainty assessment of a systems biology model requires a sample of the full probability distribution of its parameters |
title_short | Prediction uncertainty assessment of a systems biology model requires a sample of the full probability distribution of its parameters |
title_sort | prediction uncertainty assessment of a systems biology model requires a sample of the full probability distribution of its parameters |
topic | Bioinformatics |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4081139/ https://www.ncbi.nlm.nih.gov/pubmed/25024907 http://dx.doi.org/10.7717/peerj.433 |
work_keys_str_mv | AT vanmouriksimon predictionuncertaintyassessmentofasystemsbiologymodelrequiresasampleofthefullprobabilitydistributionofitsparameters AT terbraakcajo predictionuncertaintyassessmentofasystemsbiologymodelrequiresasampleofthefullprobabilitydistributionofitsparameters AT stigterhans predictionuncertaintyassessmentofasystemsbiologymodelrequiresasampleofthefullprobabilitydistributionofitsparameters AT molenaarjaap predictionuncertaintyassessmentofasystemsbiologymodelrequiresasampleofthefullprobabilitydistributionofitsparameters |