Cargando…

Auditory information enhances post-sensory visual evidence during rapid multisensory decision-making

Despite recent progress in understanding multisensory decision-making, a conclusive mechanistic account of how the brain translates the relevant evidence into a decision is lacking. Specifically, it remains unclear whether perceptual improvements during rapid multisensory decisions are best explaine...

Descripción completa

Detalles Bibliográficos
Autores principales: Franzen, Léon, Delis, Ioannis, De Sousa, Gabriela, Kayser, Christoph, Philiastides, Marios G.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7595090/
https://www.ncbi.nlm.nih.gov/pubmed/33116148
http://dx.doi.org/10.1038/s41467-020-19306-7
_version_ 1783601782187884544
author Franzen, Léon
Delis, Ioannis
De Sousa, Gabriela
Kayser, Christoph
Philiastides, Marios G.
author_facet Franzen, Léon
Delis, Ioannis
De Sousa, Gabriela
Kayser, Christoph
Philiastides, Marios G.
author_sort Franzen, Léon
collection PubMed
description Despite recent progress in understanding multisensory decision-making, a conclusive mechanistic account of how the brain translates the relevant evidence into a decision is lacking. Specifically, it remains unclear whether perceptual improvements during rapid multisensory decisions are best explained by sensory (i.e., ‘Early’) processing benefits or post-sensory (i.e., ‘Late’) changes in decision dynamics. Here, we employ a well-established visual object categorisation task in which early sensory and post-sensory decision evidence can be dissociated using multivariate pattern analysis of the electroencephalogram (EEG). We capitalize on these distinct neural components to identify when and how complementary auditory information influences the encoding of decision-relevant visual evidence in a multisensory context. We show that it is primarily the post-sensory, rather than the early sensory, EEG component amplitudes that are being amplified during rapid audiovisual decision-making. Using a neurally informed drift diffusion model we demonstrate that a multisensory behavioral improvement in accuracy arises from an enhanced quality of the relevant decision evidence, as captured by the post-sensory EEG component, consistent with the emergence of multisensory evidence in higher-order brain areas.
format Online
Article
Text
id pubmed-7595090
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-75950902020-11-10 Auditory information enhances post-sensory visual evidence during rapid multisensory decision-making Franzen, Léon Delis, Ioannis De Sousa, Gabriela Kayser, Christoph Philiastides, Marios G. Nat Commun Article Despite recent progress in understanding multisensory decision-making, a conclusive mechanistic account of how the brain translates the relevant evidence into a decision is lacking. Specifically, it remains unclear whether perceptual improvements during rapid multisensory decisions are best explained by sensory (i.e., ‘Early’) processing benefits or post-sensory (i.e., ‘Late’) changes in decision dynamics. Here, we employ a well-established visual object categorisation task in which early sensory and post-sensory decision evidence can be dissociated using multivariate pattern analysis of the electroencephalogram (EEG). We capitalize on these distinct neural components to identify when and how complementary auditory information influences the encoding of decision-relevant visual evidence in a multisensory context. We show that it is primarily the post-sensory, rather than the early sensory, EEG component amplitudes that are being amplified during rapid audiovisual decision-making. Using a neurally informed drift diffusion model we demonstrate that a multisensory behavioral improvement in accuracy arises from an enhanced quality of the relevant decision evidence, as captured by the post-sensory EEG component, consistent with the emergence of multisensory evidence in higher-order brain areas. Nature Publishing Group UK 2020-10-28 /pmc/articles/PMC7595090/ /pubmed/33116148 http://dx.doi.org/10.1038/s41467-020-19306-7 Text en © The Author(s) 2020 Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
spellingShingle Article
Franzen, Léon
Delis, Ioannis
De Sousa, Gabriela
Kayser, Christoph
Philiastides, Marios G.
Auditory information enhances post-sensory visual evidence during rapid multisensory decision-making
title Auditory information enhances post-sensory visual evidence during rapid multisensory decision-making
title_full Auditory information enhances post-sensory visual evidence during rapid multisensory decision-making
title_fullStr Auditory information enhances post-sensory visual evidence during rapid multisensory decision-making
title_full_unstemmed Auditory information enhances post-sensory visual evidence during rapid multisensory decision-making
title_short Auditory information enhances post-sensory visual evidence during rapid multisensory decision-making
title_sort auditory information enhances post-sensory visual evidence during rapid multisensory decision-making
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7595090/
https://www.ncbi.nlm.nih.gov/pubmed/33116148
http://dx.doi.org/10.1038/s41467-020-19306-7
work_keys_str_mv AT franzenleon auditoryinformationenhancespostsensoryvisualevidenceduringrapidmultisensorydecisionmaking
AT delisioannis auditoryinformationenhancespostsensoryvisualevidenceduringrapidmultisensorydecisionmaking
AT desousagabriela auditoryinformationenhancespostsensoryvisualevidenceduringrapidmultisensorydecisionmaking
AT kayserchristoph auditoryinformationenhancespostsensoryvisualevidenceduringrapidmultisensorydecisionmaking
AT philiastidesmariosg auditoryinformationenhancespostsensoryvisualevidenceduringrapidmultisensorydecisionmaking