Cargando…
Optogenetic Mimicry of the Transient Activation of Dopamine Neurons by Natural Reward Is Sufficient for Operant Reinforcement
Activation of dopamine receptors in forebrain regions, for minutes or longer, is known to be sufficient for positive reinforcement of stimuli and actions. However, the firing rate of dopamine neurons is increased for only about 200 milliseconds following natural reward events that are better than ex...
Autores principales: | , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Public Library of Science
2012
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3323614/ https://www.ncbi.nlm.nih.gov/pubmed/22506004 http://dx.doi.org/10.1371/journal.pone.0033612 |
_version_ | 1782229240729567232 |
---|---|
author | Kim, Kyung Man Baratta, Michael V. Yang, Aimei Lee, Doheon Boyden, Edward S. Fiorillo, Christopher D. |
author_facet | Kim, Kyung Man Baratta, Michael V. Yang, Aimei Lee, Doheon Boyden, Edward S. Fiorillo, Christopher D. |
author_sort | Kim, Kyung Man |
collection | PubMed |
description | Activation of dopamine receptors in forebrain regions, for minutes or longer, is known to be sufficient for positive reinforcement of stimuli and actions. However, the firing rate of dopamine neurons is increased for only about 200 milliseconds following natural reward events that are better than expected, a response which has been described as a “reward prediction error” (RPE). Although RPE drives reinforcement learning (RL) in computational models, it has not been possible to directly test whether the transient dopamine signal actually drives RL. Here we have performed optical stimulation of genetically targeted ventral tegmental area (VTA) dopamine neurons expressing Channelrhodopsin-2 (ChR2) in mice. We mimicked the transient activation of dopamine neurons that occurs in response to natural reward by applying a light pulse of 200 ms in VTA. When a single light pulse followed each self-initiated nose poke, it was sufficient in itself to cause operant reinforcement. Furthermore, when optical stimulation was delivered in separate sessions according to a predetermined pattern, it increased locomotion and contralateral rotations, behaviors that are known to result from activation of dopamine neurons. All three of the optically induced operant and locomotor behaviors were tightly correlated with the number of VTA dopamine neurons that expressed ChR2, providing additional evidence that the behavioral responses were caused by activation of dopamine neurons. These results provide strong evidence that the transient activation of dopamine neurons provides a functional reward signal that drives learning, in support of RL theories of dopamine function. |
format | Online Article Text |
id | pubmed-3323614 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2012 |
publisher | Public Library of Science |
record_format | MEDLINE/PubMed |
spelling | pubmed-33236142012-04-13 Optogenetic Mimicry of the Transient Activation of Dopamine Neurons by Natural Reward Is Sufficient for Operant Reinforcement Kim, Kyung Man Baratta, Michael V. Yang, Aimei Lee, Doheon Boyden, Edward S. Fiorillo, Christopher D. PLoS One Research Article Activation of dopamine receptors in forebrain regions, for minutes or longer, is known to be sufficient for positive reinforcement of stimuli and actions. However, the firing rate of dopamine neurons is increased for only about 200 milliseconds following natural reward events that are better than expected, a response which has been described as a “reward prediction error” (RPE). Although RPE drives reinforcement learning (RL) in computational models, it has not been possible to directly test whether the transient dopamine signal actually drives RL. Here we have performed optical stimulation of genetically targeted ventral tegmental area (VTA) dopamine neurons expressing Channelrhodopsin-2 (ChR2) in mice. We mimicked the transient activation of dopamine neurons that occurs in response to natural reward by applying a light pulse of 200 ms in VTA. When a single light pulse followed each self-initiated nose poke, it was sufficient in itself to cause operant reinforcement. Furthermore, when optical stimulation was delivered in separate sessions according to a predetermined pattern, it increased locomotion and contralateral rotations, behaviors that are known to result from activation of dopamine neurons. All three of the optically induced operant and locomotor behaviors were tightly correlated with the number of VTA dopamine neurons that expressed ChR2, providing additional evidence that the behavioral responses were caused by activation of dopamine neurons. These results provide strong evidence that the transient activation of dopamine neurons provides a functional reward signal that drives learning, in support of RL theories of dopamine function. Public Library of Science 2012-04-10 /pmc/articles/PMC3323614/ /pubmed/22506004 http://dx.doi.org/10.1371/journal.pone.0033612 Text en Kim et al. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are properly credited. |
spellingShingle | Research Article Kim, Kyung Man Baratta, Michael V. Yang, Aimei Lee, Doheon Boyden, Edward S. Fiorillo, Christopher D. Optogenetic Mimicry of the Transient Activation of Dopamine Neurons by Natural Reward Is Sufficient for Operant Reinforcement |
title | Optogenetic Mimicry of the Transient Activation of Dopamine Neurons by Natural Reward Is Sufficient for Operant Reinforcement |
title_full | Optogenetic Mimicry of the Transient Activation of Dopamine Neurons by Natural Reward Is Sufficient for Operant Reinforcement |
title_fullStr | Optogenetic Mimicry of the Transient Activation of Dopamine Neurons by Natural Reward Is Sufficient for Operant Reinforcement |
title_full_unstemmed | Optogenetic Mimicry of the Transient Activation of Dopamine Neurons by Natural Reward Is Sufficient for Operant Reinforcement |
title_short | Optogenetic Mimicry of the Transient Activation of Dopamine Neurons by Natural Reward Is Sufficient for Operant Reinforcement |
title_sort | optogenetic mimicry of the transient activation of dopamine neurons by natural reward is sufficient for operant reinforcement |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3323614/ https://www.ncbi.nlm.nih.gov/pubmed/22506004 http://dx.doi.org/10.1371/journal.pone.0033612 |
work_keys_str_mv | AT kimkyungman optogeneticmimicryofthetransientactivationofdopamineneuronsbynaturalrewardissufficientforoperantreinforcement AT barattamichaelv optogeneticmimicryofthetransientactivationofdopamineneuronsbynaturalrewardissufficientforoperantreinforcement AT yangaimei optogeneticmimicryofthetransientactivationofdopamineneuronsbynaturalrewardissufficientforoperantreinforcement AT leedoheon optogeneticmimicryofthetransientactivationofdopamineneuronsbynaturalrewardissufficientforoperantreinforcement AT boydenedwards optogeneticmimicryofthetransientactivationofdopamineneuronsbynaturalrewardissufficientforoperantreinforcement AT fiorillochristopherd optogeneticmimicryofthetransientactivationofdopamineneuronsbynaturalrewardissufficientforoperantreinforcement |