Cargando…

Universally Sloppy Parameter Sensitivities in Systems Biology Models

Quantitative computational models play an increasingly important role in modern biology. Such models typically involve many free parameters, and assigning their values is often a substantial obstacle to model development. Directly measuring in vivo biochemical parameters is difficult, and collective...

Descripción completa

Detalles Bibliográficos
Autores principales: Gutenkunst, Ryan N, Waterfall, Joshua J, Casey, Fergal P, Brown, Kevin S, Myers, Christopher R, Sethna, James P
Formato: Texto
Lenguaje:English
Publicado: Public Library of Science 2007
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2000971/
https://www.ncbi.nlm.nih.gov/pubmed/17922568
http://dx.doi.org/10.1371/journal.pcbi.0030189
_version_ 1782135562705043456
author Gutenkunst, Ryan N
Waterfall, Joshua J
Casey, Fergal P
Brown, Kevin S
Myers, Christopher R
Sethna, James P
author_facet Gutenkunst, Ryan N
Waterfall, Joshua J
Casey, Fergal P
Brown, Kevin S
Myers, Christopher R
Sethna, James P
author_sort Gutenkunst, Ryan N
collection PubMed
description Quantitative computational models play an increasingly important role in modern biology. Such models typically involve many free parameters, and assigning their values is often a substantial obstacle to model development. Directly measuring in vivo biochemical parameters is difficult, and collectively fitting them to other experimental data often yields large parameter uncertainties. Nevertheless, in earlier work we showed in a growth-factor-signaling model that collective fitting could yield well-constrained predictions, even when it left individual parameters very poorly constrained. We also showed that the model had a “sloppy” spectrum of parameter sensitivities, with eigenvalues roughly evenly distributed over many decades. Here we use a collection of models from the literature to test whether such sloppy spectra are common in systems biology. Strikingly, we find that every model we examine has a sloppy spectrum of sensitivities. We also test several consequences of this sloppiness for building predictive models. In particular, sloppiness suggests that collective fits to even large amounts of ideal time-series data will often leave many parameters poorly constrained. Tests over our model collection are consistent with this suggestion. This difficulty with collective fits may seem to argue for direct parameter measurements, but sloppiness also implies that such measurements must be formidably precise and complete to usefully constrain many model predictions. We confirm this implication in our growth-factor-signaling model. Our results suggest that sloppy sensitivity spectra are universal in systems biology models. The prevalence of sloppiness highlights the power of collective fits and suggests that modelers should focus on predictions rather than on parameters.
format Text
id pubmed-2000971
institution National Center for Biotechnology Information
language English
publishDate 2007
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-20009712007-10-25 Universally Sloppy Parameter Sensitivities in Systems Biology Models Gutenkunst, Ryan N Waterfall, Joshua J Casey, Fergal P Brown, Kevin S Myers, Christopher R Sethna, James P PLoS Comput Biol Research Article Quantitative computational models play an increasingly important role in modern biology. Such models typically involve many free parameters, and assigning their values is often a substantial obstacle to model development. Directly measuring in vivo biochemical parameters is difficult, and collectively fitting them to other experimental data often yields large parameter uncertainties. Nevertheless, in earlier work we showed in a growth-factor-signaling model that collective fitting could yield well-constrained predictions, even when it left individual parameters very poorly constrained. We also showed that the model had a “sloppy” spectrum of parameter sensitivities, with eigenvalues roughly evenly distributed over many decades. Here we use a collection of models from the literature to test whether such sloppy spectra are common in systems biology. Strikingly, we find that every model we examine has a sloppy spectrum of sensitivities. We also test several consequences of this sloppiness for building predictive models. In particular, sloppiness suggests that collective fits to even large amounts of ideal time-series data will often leave many parameters poorly constrained. Tests over our model collection are consistent with this suggestion. This difficulty with collective fits may seem to argue for direct parameter measurements, but sloppiness also implies that such measurements must be formidably precise and complete to usefully constrain many model predictions. We confirm this implication in our growth-factor-signaling model. Our results suggest that sloppy sensitivity spectra are universal in systems biology models. The prevalence of sloppiness highlights the power of collective fits and suggests that modelers should focus on predictions rather than on parameters. Public Library of Science 2007-10 2007-10-05 /pmc/articles/PMC2000971/ /pubmed/17922568 http://dx.doi.org/10.1371/journal.pcbi.0030189 Text en © 2007 Gutenkunst et al. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are properly credited.
spellingShingle Research Article
Gutenkunst, Ryan N
Waterfall, Joshua J
Casey, Fergal P
Brown, Kevin S
Myers, Christopher R
Sethna, James P
Universally Sloppy Parameter Sensitivities in Systems Biology Models
title Universally Sloppy Parameter Sensitivities in Systems Biology Models
title_full Universally Sloppy Parameter Sensitivities in Systems Biology Models
title_fullStr Universally Sloppy Parameter Sensitivities in Systems Biology Models
title_full_unstemmed Universally Sloppy Parameter Sensitivities in Systems Biology Models
title_short Universally Sloppy Parameter Sensitivities in Systems Biology Models
title_sort universally sloppy parameter sensitivities in systems biology models
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2000971/
https://www.ncbi.nlm.nih.gov/pubmed/17922568
http://dx.doi.org/10.1371/journal.pcbi.0030189
work_keys_str_mv AT gutenkunstryann universallysloppyparametersensitivitiesinsystemsbiologymodels
AT waterfalljoshuaj universallysloppyparametersensitivitiesinsystemsbiologymodels
AT caseyfergalp universallysloppyparametersensitivitiesinsystemsbiologymodels
AT brownkevins universallysloppyparametersensitivitiesinsystemsbiologymodels
AT myerschristopherr universallysloppyparametersensitivitiesinsystemsbiologymodels
AT sethnajamesp universallysloppyparametersensitivitiesinsystemsbiologymodels