Cargando…

Prediction uncertainty assessment of a systems biology model requires a sample of the full probability distribution of its parameters

Multi-parameter models in systems biology are typically ‘sloppy’: some parameters or combinations of parameters may be hard to estimate from data, whereas others are not. One might expect that parameter uncertainty automatically leads to uncertain predictions, but this is not the case. We illustrate...

Descripción completa

Detalles Bibliográficos
Autores principales: van Mourik, Simon, ter Braak, Cajo, Stigter, Hans, Molenaar, Jaap
Formato: Online Artículo Texto
Lenguaje:English
Publicado: PeerJ Inc. 2014
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4081139/
https://www.ncbi.nlm.nih.gov/pubmed/25024907
http://dx.doi.org/10.7717/peerj.433
_version_ 1782324075025137664
author van Mourik, Simon
ter Braak, Cajo
Stigter, Hans
Molenaar, Jaap
author_facet van Mourik, Simon
ter Braak, Cajo
Stigter, Hans
Molenaar, Jaap
author_sort van Mourik, Simon
collection PubMed
description Multi-parameter models in systems biology are typically ‘sloppy’: some parameters or combinations of parameters may be hard to estimate from data, whereas others are not. One might expect that parameter uncertainty automatically leads to uncertain predictions, but this is not the case. We illustrate this by showing that the prediction uncertainty of each of six sloppy models varies enormously among different predictions. Statistical approximations of parameter uncertainty may lead to dramatic errors in prediction uncertainty estimation. We argue that prediction uncertainty assessment must therefore be performed on a per-prediction basis using a full computational uncertainty analysis. In practice this is feasible by providing a model with a sample or ensemble representing the distribution of its parameters. Within a Bayesian framework, such a sample may be generated by a Markov Chain Monte Carlo (MCMC) algorithm that infers the parameter distribution based on experimental data. Matlab code for generating the sample (with the Differential Evolution Markov Chain sampler) and the subsequent uncertainty analysis using such a sample, is supplied as Supplemental Information.
format Online
Article
Text
id pubmed-4081139
institution National Center for Biotechnology Information
language English
publishDate 2014
publisher PeerJ Inc.
record_format MEDLINE/PubMed
spelling pubmed-40811392014-07-14 Prediction uncertainty assessment of a systems biology model requires a sample of the full probability distribution of its parameters van Mourik, Simon ter Braak, Cajo Stigter, Hans Molenaar, Jaap PeerJ Bioinformatics Multi-parameter models in systems biology are typically ‘sloppy’: some parameters or combinations of parameters may be hard to estimate from data, whereas others are not. One might expect that parameter uncertainty automatically leads to uncertain predictions, but this is not the case. We illustrate this by showing that the prediction uncertainty of each of six sloppy models varies enormously among different predictions. Statistical approximations of parameter uncertainty may lead to dramatic errors in prediction uncertainty estimation. We argue that prediction uncertainty assessment must therefore be performed on a per-prediction basis using a full computational uncertainty analysis. In practice this is feasible by providing a model with a sample or ensemble representing the distribution of its parameters. Within a Bayesian framework, such a sample may be generated by a Markov Chain Monte Carlo (MCMC) algorithm that infers the parameter distribution based on experimental data. Matlab code for generating the sample (with the Differential Evolution Markov Chain sampler) and the subsequent uncertainty analysis using such a sample, is supplied as Supplemental Information. PeerJ Inc. 2014-06-17 /pmc/articles/PMC4081139/ /pubmed/25024907 http://dx.doi.org/10.7717/peerj.433 Text en © 2014 van Mourik et al. http://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, reproduction and adaptation in any medium and for any purpose provided that it is properly attributed. For attribution, the original author(s), title, publication source (PeerJ) and either DOI or URL of the article must be cited.
spellingShingle Bioinformatics
van Mourik, Simon
ter Braak, Cajo
Stigter, Hans
Molenaar, Jaap
Prediction uncertainty assessment of a systems biology model requires a sample of the full probability distribution of its parameters
title Prediction uncertainty assessment of a systems biology model requires a sample of the full probability distribution of its parameters
title_full Prediction uncertainty assessment of a systems biology model requires a sample of the full probability distribution of its parameters
title_fullStr Prediction uncertainty assessment of a systems biology model requires a sample of the full probability distribution of its parameters
title_full_unstemmed Prediction uncertainty assessment of a systems biology model requires a sample of the full probability distribution of its parameters
title_short Prediction uncertainty assessment of a systems biology model requires a sample of the full probability distribution of its parameters
title_sort prediction uncertainty assessment of a systems biology model requires a sample of the full probability distribution of its parameters
topic Bioinformatics
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4081139/
https://www.ncbi.nlm.nih.gov/pubmed/25024907
http://dx.doi.org/10.7717/peerj.433
work_keys_str_mv AT vanmouriksimon predictionuncertaintyassessmentofasystemsbiologymodelrequiresasampleofthefullprobabilitydistributionofitsparameters
AT terbraakcajo predictionuncertaintyassessmentofasystemsbiologymodelrequiresasampleofthefullprobabilitydistributionofitsparameters
AT stigterhans predictionuncertaintyassessmentofasystemsbiologymodelrequiresasampleofthefullprobabilitydistributionofitsparameters
AT molenaarjaap predictionuncertaintyassessmentofasystemsbiologymodelrequiresasampleofthefullprobabilitydistributionofitsparameters