Cargando…

Reinforcement learning can account for associative and perceptual learning on a visual decision task

We recently showed that improved perceptual performance on a visual motion direction-discrimination task corresponds to changes not in how sensory information is represented in the brain but rather how that information is interpreted to form a decision that guides behaviour. Here we show that these...

Descripción completa

Detalles Bibliográficos
Autores principales: Law, Chi-Tat, Gold, Joshua I.
Formato: Texto
Lenguaje:English
Publicado: 2009
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2674144/
https://www.ncbi.nlm.nih.gov/pubmed/19377473
http://dx.doi.org/10.1038/nn.2304
_version_ 1782166619278016512
author Law, Chi-Tat
Gold, Joshua I.
author_facet Law, Chi-Tat
Gold, Joshua I.
author_sort Law, Chi-Tat
collection PubMed
description We recently showed that improved perceptual performance on a visual motion direction-discrimination task corresponds to changes not in how sensory information is represented in the brain but rather how that information is interpreted to form a decision that guides behaviour. Here we show that these changes can be accounted for using a reinforcement learning rule to shape functional connectivity between the sensory and decision neurons. We modelled performance based on the readout of simulated responses of direction-selective sensory neurons in the middle temporal area (MT) of monkey cortex. A reward prediction error guided changes in connections between these sensory neurons and the decision process, first establishing the association between motion direction and response direction and then gradually improving perceptual sensitivity by selectively strengthening the connections from the most sensitive neurons in the sensory population. The results suggest a common, feedback-driven mechanism for some forms of associative and perceptual learning.
format Text
id pubmed-2674144
institution National Center for Biotechnology Information
language English
publishDate 2009
record_format MEDLINE/PubMed
spelling pubmed-26741442009-11-01 Reinforcement learning can account for associative and perceptual learning on a visual decision task Law, Chi-Tat Gold, Joshua I. Nat Neurosci Article We recently showed that improved perceptual performance on a visual motion direction-discrimination task corresponds to changes not in how sensory information is represented in the brain but rather how that information is interpreted to form a decision that guides behaviour. Here we show that these changes can be accounted for using a reinforcement learning rule to shape functional connectivity between the sensory and decision neurons. We modelled performance based on the readout of simulated responses of direction-selective sensory neurons in the middle temporal area (MT) of monkey cortex. A reward prediction error guided changes in connections between these sensory neurons and the decision process, first establishing the association between motion direction and response direction and then gradually improving perceptual sensitivity by selectively strengthening the connections from the most sensitive neurons in the sensory population. The results suggest a common, feedback-driven mechanism for some forms of associative and perceptual learning. 2009-04-19 2009-05 /pmc/articles/PMC2674144/ /pubmed/19377473 http://dx.doi.org/10.1038/nn.2304 Text en http://www.nature.com/authors/editorial_policies/license.html#terms Users may view, print, copy, and download text and data-mine the content in such documents, for the purposes of academic research, subject always to the full Conditions of use:http://www.nature.com/authors/editorial_policies/license.html#terms
spellingShingle Article
Law, Chi-Tat
Gold, Joshua I.
Reinforcement learning can account for associative and perceptual learning on a visual decision task
title Reinforcement learning can account for associative and perceptual learning on a visual decision task
title_full Reinforcement learning can account for associative and perceptual learning on a visual decision task
title_fullStr Reinforcement learning can account for associative and perceptual learning on a visual decision task
title_full_unstemmed Reinforcement learning can account for associative and perceptual learning on a visual decision task
title_short Reinforcement learning can account for associative and perceptual learning on a visual decision task
title_sort reinforcement learning can account for associative and perceptual learning on a visual decision task
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2674144/
https://www.ncbi.nlm.nih.gov/pubmed/19377473
http://dx.doi.org/10.1038/nn.2304
work_keys_str_mv AT lawchitat reinforcementlearningcanaccountforassociativeandperceptuallearningonavisualdecisiontask
AT goldjoshuai reinforcementlearningcanaccountforassociativeandperceptuallearningonavisualdecisiontask