Cargando…
Auditory information enhances post-sensory visual evidence during rapid multisensory decision-making
Despite recent progress in understanding multisensory decision-making, a conclusive mechanistic account of how the brain translates the relevant evidence into a decision is lacking. Specifically, it remains unclear whether perceptual improvements during rapid multisensory decisions are best explaine...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2020
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7595090/ https://www.ncbi.nlm.nih.gov/pubmed/33116148 http://dx.doi.org/10.1038/s41467-020-19306-7 |
_version_ | 1783601782187884544 |
---|---|
author | Franzen, Léon Delis, Ioannis De Sousa, Gabriela Kayser, Christoph Philiastides, Marios G. |
author_facet | Franzen, Léon Delis, Ioannis De Sousa, Gabriela Kayser, Christoph Philiastides, Marios G. |
author_sort | Franzen, Léon |
collection | PubMed |
description | Despite recent progress in understanding multisensory decision-making, a conclusive mechanistic account of how the brain translates the relevant evidence into a decision is lacking. Specifically, it remains unclear whether perceptual improvements during rapid multisensory decisions are best explained by sensory (i.e., ‘Early’) processing benefits or post-sensory (i.e., ‘Late’) changes in decision dynamics. Here, we employ a well-established visual object categorisation task in which early sensory and post-sensory decision evidence can be dissociated using multivariate pattern analysis of the electroencephalogram (EEG). We capitalize on these distinct neural components to identify when and how complementary auditory information influences the encoding of decision-relevant visual evidence in a multisensory context. We show that it is primarily the post-sensory, rather than the early sensory, EEG component amplitudes that are being amplified during rapid audiovisual decision-making. Using a neurally informed drift diffusion model we demonstrate that a multisensory behavioral improvement in accuracy arises from an enhanced quality of the relevant decision evidence, as captured by the post-sensory EEG component, consistent with the emergence of multisensory evidence in higher-order brain areas. |
format | Online Article Text |
id | pubmed-7595090 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2020 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-75950902020-11-10 Auditory information enhances post-sensory visual evidence during rapid multisensory decision-making Franzen, Léon Delis, Ioannis De Sousa, Gabriela Kayser, Christoph Philiastides, Marios G. Nat Commun Article Despite recent progress in understanding multisensory decision-making, a conclusive mechanistic account of how the brain translates the relevant evidence into a decision is lacking. Specifically, it remains unclear whether perceptual improvements during rapid multisensory decisions are best explained by sensory (i.e., ‘Early’) processing benefits or post-sensory (i.e., ‘Late’) changes in decision dynamics. Here, we employ a well-established visual object categorisation task in which early sensory and post-sensory decision evidence can be dissociated using multivariate pattern analysis of the electroencephalogram (EEG). We capitalize on these distinct neural components to identify when and how complementary auditory information influences the encoding of decision-relevant visual evidence in a multisensory context. We show that it is primarily the post-sensory, rather than the early sensory, EEG component amplitudes that are being amplified during rapid audiovisual decision-making. Using a neurally informed drift diffusion model we demonstrate that a multisensory behavioral improvement in accuracy arises from an enhanced quality of the relevant decision evidence, as captured by the post-sensory EEG component, consistent with the emergence of multisensory evidence in higher-order brain areas. Nature Publishing Group UK 2020-10-28 /pmc/articles/PMC7595090/ /pubmed/33116148 http://dx.doi.org/10.1038/s41467-020-19306-7 Text en © The Author(s) 2020 Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/. |
spellingShingle | Article Franzen, Léon Delis, Ioannis De Sousa, Gabriela Kayser, Christoph Philiastides, Marios G. Auditory information enhances post-sensory visual evidence during rapid multisensory decision-making |
title | Auditory information enhances post-sensory visual evidence during rapid multisensory decision-making |
title_full | Auditory information enhances post-sensory visual evidence during rapid multisensory decision-making |
title_fullStr | Auditory information enhances post-sensory visual evidence during rapid multisensory decision-making |
title_full_unstemmed | Auditory information enhances post-sensory visual evidence during rapid multisensory decision-making |
title_short | Auditory information enhances post-sensory visual evidence during rapid multisensory decision-making |
title_sort | auditory information enhances post-sensory visual evidence during rapid multisensory decision-making |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7595090/ https://www.ncbi.nlm.nih.gov/pubmed/33116148 http://dx.doi.org/10.1038/s41467-020-19306-7 |
work_keys_str_mv | AT franzenleon auditoryinformationenhancespostsensoryvisualevidenceduringrapidmultisensorydecisionmaking AT delisioannis auditoryinformationenhancespostsensoryvisualevidenceduringrapidmultisensorydecisionmaking AT desousagabriela auditoryinformationenhancespostsensoryvisualevidenceduringrapidmultisensorydecisionmaking AT kayserchristoph auditoryinformationenhancespostsensoryvisualevidenceduringrapidmultisensorydecisionmaking AT philiastidesmariosg auditoryinformationenhancespostsensoryvisualevidenceduringrapidmultisensorydecisionmaking |