Cargando…

Optogenetic Mimicry of the Transient Activation of Dopamine Neurons by Natural Reward Is Sufficient for Operant Reinforcement

Activation of dopamine receptors in forebrain regions, for minutes or longer, is known to be sufficient for positive reinforcement of stimuli and actions. However, the firing rate of dopamine neurons is increased for only about 200 milliseconds following natural reward events that are better than ex...

Descripción completa

Detalles Bibliográficos
Autores principales: Kim, Kyung Man, Baratta, Michael V., Yang, Aimei, Lee, Doheon, Boyden, Edward S., Fiorillo, Christopher D.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2012
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3323614/
https://www.ncbi.nlm.nih.gov/pubmed/22506004
http://dx.doi.org/10.1371/journal.pone.0033612
_version_ 1782229240729567232
author Kim, Kyung Man
Baratta, Michael V.
Yang, Aimei
Lee, Doheon
Boyden, Edward S.
Fiorillo, Christopher D.
author_facet Kim, Kyung Man
Baratta, Michael V.
Yang, Aimei
Lee, Doheon
Boyden, Edward S.
Fiorillo, Christopher D.
author_sort Kim, Kyung Man
collection PubMed
description Activation of dopamine receptors in forebrain regions, for minutes or longer, is known to be sufficient for positive reinforcement of stimuli and actions. However, the firing rate of dopamine neurons is increased for only about 200 milliseconds following natural reward events that are better than expected, a response which has been described as a “reward prediction error” (RPE). Although RPE drives reinforcement learning (RL) in computational models, it has not been possible to directly test whether the transient dopamine signal actually drives RL. Here we have performed optical stimulation of genetically targeted ventral tegmental area (VTA) dopamine neurons expressing Channelrhodopsin-2 (ChR2) in mice. We mimicked the transient activation of dopamine neurons that occurs in response to natural reward by applying a light pulse of 200 ms in VTA. When a single light pulse followed each self-initiated nose poke, it was sufficient in itself to cause operant reinforcement. Furthermore, when optical stimulation was delivered in separate sessions according to a predetermined pattern, it increased locomotion and contralateral rotations, behaviors that are known to result from activation of dopamine neurons. All three of the optically induced operant and locomotor behaviors were tightly correlated with the number of VTA dopamine neurons that expressed ChR2, providing additional evidence that the behavioral responses were caused by activation of dopamine neurons. These results provide strong evidence that the transient activation of dopamine neurons provides a functional reward signal that drives learning, in support of RL theories of dopamine function.
format Online
Article
Text
id pubmed-3323614
institution National Center for Biotechnology Information
language English
publishDate 2012
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-33236142012-04-13 Optogenetic Mimicry of the Transient Activation of Dopamine Neurons by Natural Reward Is Sufficient for Operant Reinforcement Kim, Kyung Man Baratta, Michael V. Yang, Aimei Lee, Doheon Boyden, Edward S. Fiorillo, Christopher D. PLoS One Research Article Activation of dopamine receptors in forebrain regions, for minutes or longer, is known to be sufficient for positive reinforcement of stimuli and actions. However, the firing rate of dopamine neurons is increased for only about 200 milliseconds following natural reward events that are better than expected, a response which has been described as a “reward prediction error” (RPE). Although RPE drives reinforcement learning (RL) in computational models, it has not been possible to directly test whether the transient dopamine signal actually drives RL. Here we have performed optical stimulation of genetically targeted ventral tegmental area (VTA) dopamine neurons expressing Channelrhodopsin-2 (ChR2) in mice. We mimicked the transient activation of dopamine neurons that occurs in response to natural reward by applying a light pulse of 200 ms in VTA. When a single light pulse followed each self-initiated nose poke, it was sufficient in itself to cause operant reinforcement. Furthermore, when optical stimulation was delivered in separate sessions according to a predetermined pattern, it increased locomotion and contralateral rotations, behaviors that are known to result from activation of dopamine neurons. All three of the optically induced operant and locomotor behaviors were tightly correlated with the number of VTA dopamine neurons that expressed ChR2, providing additional evidence that the behavioral responses were caused by activation of dopamine neurons. These results provide strong evidence that the transient activation of dopamine neurons provides a functional reward signal that drives learning, in support of RL theories of dopamine function. Public Library of Science 2012-04-10 /pmc/articles/PMC3323614/ /pubmed/22506004 http://dx.doi.org/10.1371/journal.pone.0033612 Text en Kim et al. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are properly credited.
spellingShingle Research Article
Kim, Kyung Man
Baratta, Michael V.
Yang, Aimei
Lee, Doheon
Boyden, Edward S.
Fiorillo, Christopher D.
Optogenetic Mimicry of the Transient Activation of Dopamine Neurons by Natural Reward Is Sufficient for Operant Reinforcement
title Optogenetic Mimicry of the Transient Activation of Dopamine Neurons by Natural Reward Is Sufficient for Operant Reinforcement
title_full Optogenetic Mimicry of the Transient Activation of Dopamine Neurons by Natural Reward Is Sufficient for Operant Reinforcement
title_fullStr Optogenetic Mimicry of the Transient Activation of Dopamine Neurons by Natural Reward Is Sufficient for Operant Reinforcement
title_full_unstemmed Optogenetic Mimicry of the Transient Activation of Dopamine Neurons by Natural Reward Is Sufficient for Operant Reinforcement
title_short Optogenetic Mimicry of the Transient Activation of Dopamine Neurons by Natural Reward Is Sufficient for Operant Reinforcement
title_sort optogenetic mimicry of the transient activation of dopamine neurons by natural reward is sufficient for operant reinforcement
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3323614/
https://www.ncbi.nlm.nih.gov/pubmed/22506004
http://dx.doi.org/10.1371/journal.pone.0033612
work_keys_str_mv AT kimkyungman optogeneticmimicryofthetransientactivationofdopamineneuronsbynaturalrewardissufficientforoperantreinforcement
AT barattamichaelv optogeneticmimicryofthetransientactivationofdopamineneuronsbynaturalrewardissufficientforoperantreinforcement
AT yangaimei optogeneticmimicryofthetransientactivationofdopamineneuronsbynaturalrewardissufficientforoperantreinforcement
AT leedoheon optogeneticmimicryofthetransientactivationofdopamineneuronsbynaturalrewardissufficientforoperantreinforcement
AT boydenedwards optogeneticmimicryofthetransientactivationofdopamineneuronsbynaturalrewardissufficientforoperantreinforcement
AT fiorillochristopherd optogeneticmimicryofthetransientactivationofdopamineneuronsbynaturalrewardissufficientforoperantreinforcement