Cargando…
A Mixture of Delta-Rules Approximation to Bayesian Inference in Change-Point Problems
Error-driven learning rules have received considerable attention because of their close relationships to both optimal theory and neurobiological mechanisms. However, basic forms of these rules are effective under only a restricted set of conditions in which the environment is stable. Recent studies...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Public Library of Science
2013
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3723502/ https://www.ncbi.nlm.nih.gov/pubmed/23935472 http://dx.doi.org/10.1371/journal.pcbi.1003150 |
_version_ | 1782278284921274368 |
---|---|
author | Wilson, Robert C. Nassar, Matthew R. Gold, Joshua I. |
author_facet | Wilson, Robert C. Nassar, Matthew R. Gold, Joshua I. |
author_sort | Wilson, Robert C. |
collection | PubMed |
description | Error-driven learning rules have received considerable attention because of their close relationships to both optimal theory and neurobiological mechanisms. However, basic forms of these rules are effective under only a restricted set of conditions in which the environment is stable. Recent studies have defined optimal solutions to learning problems in more general, potentially unstable, environments, but the relevance of these complex mathematical solutions to how the brain solves these problems remains unclear. Here, we show that one such Bayesian solution can be approximated by a computationally straightforward mixture of simple error-driven ‘Delta’ rules. This simpler model can make effective inferences in a dynamic environment and matches human performance on a predictive-inference task using a mixture of a small number of Delta rules. This model represents an important conceptual advance in our understanding of how the brain can use relatively simple computations to make nearly optimal inferences in a dynamic world. |
format | Online Article Text |
id | pubmed-3723502 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2013 |
publisher | Public Library of Science |
record_format | MEDLINE/PubMed |
spelling | pubmed-37235022013-08-09 A Mixture of Delta-Rules Approximation to Bayesian Inference in Change-Point Problems Wilson, Robert C. Nassar, Matthew R. Gold, Joshua I. PLoS Comput Biol Research Article Error-driven learning rules have received considerable attention because of their close relationships to both optimal theory and neurobiological mechanisms. However, basic forms of these rules are effective under only a restricted set of conditions in which the environment is stable. Recent studies have defined optimal solutions to learning problems in more general, potentially unstable, environments, but the relevance of these complex mathematical solutions to how the brain solves these problems remains unclear. Here, we show that one such Bayesian solution can be approximated by a computationally straightforward mixture of simple error-driven ‘Delta’ rules. This simpler model can make effective inferences in a dynamic environment and matches human performance on a predictive-inference task using a mixture of a small number of Delta rules. This model represents an important conceptual advance in our understanding of how the brain can use relatively simple computations to make nearly optimal inferences in a dynamic world. Public Library of Science 2013-07-25 /pmc/articles/PMC3723502/ /pubmed/23935472 http://dx.doi.org/10.1371/journal.pcbi.1003150 Text en © 2013 Wilson et al http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are properly credited. |
spellingShingle | Research Article Wilson, Robert C. Nassar, Matthew R. Gold, Joshua I. A Mixture of Delta-Rules Approximation to Bayesian Inference in Change-Point Problems |
title | A Mixture of Delta-Rules Approximation to Bayesian Inference in Change-Point Problems |
title_full | A Mixture of Delta-Rules Approximation to Bayesian Inference in Change-Point Problems |
title_fullStr | A Mixture of Delta-Rules Approximation to Bayesian Inference in Change-Point Problems |
title_full_unstemmed | A Mixture of Delta-Rules Approximation to Bayesian Inference in Change-Point Problems |
title_short | A Mixture of Delta-Rules Approximation to Bayesian Inference in Change-Point Problems |
title_sort | mixture of delta-rules approximation to bayesian inference in change-point problems |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3723502/ https://www.ncbi.nlm.nih.gov/pubmed/23935472 http://dx.doi.org/10.1371/journal.pcbi.1003150 |
work_keys_str_mv | AT wilsonrobertc amixtureofdeltarulesapproximationtobayesianinferenceinchangepointproblems AT nassarmatthewr amixtureofdeltarulesapproximationtobayesianinferenceinchangepointproblems AT goldjoshuai amixtureofdeltarulesapproximationtobayesianinferenceinchangepointproblems AT wilsonrobertc mixtureofdeltarulesapproximationtobayesianinferenceinchangepointproblems AT nassarmatthewr mixtureofdeltarulesapproximationtobayesianinferenceinchangepointproblems AT goldjoshuai mixtureofdeltarulesapproximationtobayesianinferenceinchangepointproblems |