Cargando…

An MEG signature corresponding to an axiomatic model of reward prediction error

Optimal decision-making is guided by evaluating the outcomes of previous decisions. Prediction errors are theoretical teaching signals which integrate two features of an outcome: its inherent value and prior expectation of its occurrence. To uncover the magnetic signature of prediction errors in the...

Descripción completa

Detalles Bibliográficos
Autores principales: Talmi, Deborah, Fuentemilla, Lluis, Litvak, Vladimir, Duzel, Emrah, Dolan, Raymond J.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Academic Press 2012
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3200436/
https://www.ncbi.nlm.nih.gov/pubmed/21726648
http://dx.doi.org/10.1016/j.neuroimage.2011.06.051
_version_ 1782214695836450816
author Talmi, Deborah
Fuentemilla, Lluis
Litvak, Vladimir
Duzel, Emrah
Dolan, Raymond J.
author_facet Talmi, Deborah
Fuentemilla, Lluis
Litvak, Vladimir
Duzel, Emrah
Dolan, Raymond J.
author_sort Talmi, Deborah
collection PubMed
description Optimal decision-making is guided by evaluating the outcomes of previous decisions. Prediction errors are theoretical teaching signals which integrate two features of an outcome: its inherent value and prior expectation of its occurrence. To uncover the magnetic signature of prediction errors in the human brain we acquired magnetoencephalographic (MEG) data while participants performed a gambling task. Our primary objective was to use formal criteria, based upon an axiomatic model (Caplin and Dean, 2008a), to determine the presence and timing profile of MEG signals that express prediction errors. We report analyses at the sensor level, implemented in SPM8, time locked to outcome onset. We identified, for the first time, a MEG signature of prediction error, which emerged approximately 320 ms after an outcome and expressed as an interaction between outcome valence and probability. This signal followed earlier, separate signals for outcome valence and probability, which emerged approximately 200 ms after an outcome. Strikingly, the time course of the prediction error signal, as well as the early valence signal, resembled the Feedback-Related Negativity (FRN). In simultaneously acquired EEG data we obtained a robust FRN, but the win and loss signals that comprised this difference wave did not comply with the axiomatic model. Our findings motivate an explicit examination of the critical issue of timing embodied in computational models of prediction errors as seen in human electrophysiological data.
format Online
Article
Text
id pubmed-3200436
institution National Center for Biotechnology Information
language English
publishDate 2012
publisher Academic Press
record_format MEDLINE/PubMed
spelling pubmed-32004362012-01-02 An MEG signature corresponding to an axiomatic model of reward prediction error Talmi, Deborah Fuentemilla, Lluis Litvak, Vladimir Duzel, Emrah Dolan, Raymond J. Neuroimage Article Optimal decision-making is guided by evaluating the outcomes of previous decisions. Prediction errors are theoretical teaching signals which integrate two features of an outcome: its inherent value and prior expectation of its occurrence. To uncover the magnetic signature of prediction errors in the human brain we acquired magnetoencephalographic (MEG) data while participants performed a gambling task. Our primary objective was to use formal criteria, based upon an axiomatic model (Caplin and Dean, 2008a), to determine the presence and timing profile of MEG signals that express prediction errors. We report analyses at the sensor level, implemented in SPM8, time locked to outcome onset. We identified, for the first time, a MEG signature of prediction error, which emerged approximately 320 ms after an outcome and expressed as an interaction between outcome valence and probability. This signal followed earlier, separate signals for outcome valence and probability, which emerged approximately 200 ms after an outcome. Strikingly, the time course of the prediction error signal, as well as the early valence signal, resembled the Feedback-Related Negativity (FRN). In simultaneously acquired EEG data we obtained a robust FRN, but the win and loss signals that comprised this difference wave did not comply with the axiomatic model. Our findings motivate an explicit examination of the critical issue of timing embodied in computational models of prediction errors as seen in human electrophysiological data. Academic Press 2012-01-02 /pmc/articles/PMC3200436/ /pubmed/21726648 http://dx.doi.org/10.1016/j.neuroimage.2011.06.051 Text en © 2012 Elsevier Inc. https://creativecommons.org/licenses/by/3.0/ Open Access under CC BY 3.0 (https://creativecommons.org/licenses/by/3.0/) license
spellingShingle Article
Talmi, Deborah
Fuentemilla, Lluis
Litvak, Vladimir
Duzel, Emrah
Dolan, Raymond J.
An MEG signature corresponding to an axiomatic model of reward prediction error
title An MEG signature corresponding to an axiomatic model of reward prediction error
title_full An MEG signature corresponding to an axiomatic model of reward prediction error
title_fullStr An MEG signature corresponding to an axiomatic model of reward prediction error
title_full_unstemmed An MEG signature corresponding to an axiomatic model of reward prediction error
title_short An MEG signature corresponding to an axiomatic model of reward prediction error
title_sort meg signature corresponding to an axiomatic model of reward prediction error
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3200436/
https://www.ncbi.nlm.nih.gov/pubmed/21726648
http://dx.doi.org/10.1016/j.neuroimage.2011.06.051
work_keys_str_mv AT talmideborah anmegsignaturecorrespondingtoanaxiomaticmodelofrewardpredictionerror
AT fuentemillalluis anmegsignaturecorrespondingtoanaxiomaticmodelofrewardpredictionerror
AT litvakvladimir anmegsignaturecorrespondingtoanaxiomaticmodelofrewardpredictionerror
AT duzelemrah anmegsignaturecorrespondingtoanaxiomaticmodelofrewardpredictionerror
AT dolanraymondj anmegsignaturecorrespondingtoanaxiomaticmodelofrewardpredictionerror
AT talmideborah megsignaturecorrespondingtoanaxiomaticmodelofrewardpredictionerror
AT fuentemillalluis megsignaturecorrespondingtoanaxiomaticmodelofrewardpredictionerror
AT litvakvladimir megsignaturecorrespondingtoanaxiomaticmodelofrewardpredictionerror
AT duzelemrah megsignaturecorrespondingtoanaxiomaticmodelofrewardpredictionerror
AT dolanraymondj megsignaturecorrespondingtoanaxiomaticmodelofrewardpredictionerror