Cargando…

A Mixture of Delta-Rules Approximation to Bayesian Inference in Change-Point Problems

Error-driven learning rules have received considerable attention because of their close relationships to both optimal theory and neurobiological mechanisms. However, basic forms of these rules are effective under only a restricted set of conditions in which the environment is stable. Recent studies...

Descripción completa

Detalles Bibliográficos
Autores principales: Wilson, Robert C., Nassar, Matthew R., Gold, Joshua I.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2013
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3723502/
https://www.ncbi.nlm.nih.gov/pubmed/23935472
http://dx.doi.org/10.1371/journal.pcbi.1003150
_version_ 1782278284921274368
author Wilson, Robert C.
Nassar, Matthew R.
Gold, Joshua I.
author_facet Wilson, Robert C.
Nassar, Matthew R.
Gold, Joshua I.
author_sort Wilson, Robert C.
collection PubMed
description Error-driven learning rules have received considerable attention because of their close relationships to both optimal theory and neurobiological mechanisms. However, basic forms of these rules are effective under only a restricted set of conditions in which the environment is stable. Recent studies have defined optimal solutions to learning problems in more general, potentially unstable, environments, but the relevance of these complex mathematical solutions to how the brain solves these problems remains unclear. Here, we show that one such Bayesian solution can be approximated by a computationally straightforward mixture of simple error-driven ‘Delta’ rules. This simpler model can make effective inferences in a dynamic environment and matches human performance on a predictive-inference task using a mixture of a small number of Delta rules. This model represents an important conceptual advance in our understanding of how the brain can use relatively simple computations to make nearly optimal inferences in a dynamic world.
format Online
Article
Text
id pubmed-3723502
institution National Center for Biotechnology Information
language English
publishDate 2013
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-37235022013-08-09 A Mixture of Delta-Rules Approximation to Bayesian Inference in Change-Point Problems Wilson, Robert C. Nassar, Matthew R. Gold, Joshua I. PLoS Comput Biol Research Article Error-driven learning rules have received considerable attention because of their close relationships to both optimal theory and neurobiological mechanisms. However, basic forms of these rules are effective under only a restricted set of conditions in which the environment is stable. Recent studies have defined optimal solutions to learning problems in more general, potentially unstable, environments, but the relevance of these complex mathematical solutions to how the brain solves these problems remains unclear. Here, we show that one such Bayesian solution can be approximated by a computationally straightforward mixture of simple error-driven ‘Delta’ rules. This simpler model can make effective inferences in a dynamic environment and matches human performance on a predictive-inference task using a mixture of a small number of Delta rules. This model represents an important conceptual advance in our understanding of how the brain can use relatively simple computations to make nearly optimal inferences in a dynamic world. Public Library of Science 2013-07-25 /pmc/articles/PMC3723502/ /pubmed/23935472 http://dx.doi.org/10.1371/journal.pcbi.1003150 Text en © 2013 Wilson et al http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are properly credited.
spellingShingle Research Article
Wilson, Robert C.
Nassar, Matthew R.
Gold, Joshua I.
A Mixture of Delta-Rules Approximation to Bayesian Inference in Change-Point Problems
title A Mixture of Delta-Rules Approximation to Bayesian Inference in Change-Point Problems
title_full A Mixture of Delta-Rules Approximation to Bayesian Inference in Change-Point Problems
title_fullStr A Mixture of Delta-Rules Approximation to Bayesian Inference in Change-Point Problems
title_full_unstemmed A Mixture of Delta-Rules Approximation to Bayesian Inference in Change-Point Problems
title_short A Mixture of Delta-Rules Approximation to Bayesian Inference in Change-Point Problems
title_sort mixture of delta-rules approximation to bayesian inference in change-point problems
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3723502/
https://www.ncbi.nlm.nih.gov/pubmed/23935472
http://dx.doi.org/10.1371/journal.pcbi.1003150
work_keys_str_mv AT wilsonrobertc amixtureofdeltarulesapproximationtobayesianinferenceinchangepointproblems
AT nassarmatthewr amixtureofdeltarulesapproximationtobayesianinferenceinchangepointproblems
AT goldjoshuai amixtureofdeltarulesapproximationtobayesianinferenceinchangepointproblems
AT wilsonrobertc mixtureofdeltarulesapproximationtobayesianinferenceinchangepointproblems
AT nassarmatthewr mixtureofdeltarulesapproximationtobayesianinferenceinchangepointproblems
AT goldjoshuai mixtureofdeltarulesapproximationtobayesianinferenceinchangepointproblems