Cargando…

Memorable Audiovisual Narratives Synchronize Sensory and Supramodal Neural Responses

Our brains integrate information across sensory modalities to generate perceptual experiences and form memories. However, it is difficult to determine the conditions under which multisensory stimulation will benefit or hinder the retrieval of everyday experiences. We hypothesized that the determinin...

Descripción completa

Detalles Bibliográficos
Autores principales: Cohen, Samantha S., Parra, Lucas C.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Society for Neuroscience 2016
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5103161/
https://www.ncbi.nlm.nih.gov/pubmed/27844062
http://dx.doi.org/10.1523/ENEURO.0203-16.2016
_version_ 1782466541240975360
author Cohen, Samantha S.
Parra, Lucas C.
author_facet Cohen, Samantha S.
Parra, Lucas C.
author_sort Cohen, Samantha S.
collection PubMed
description Our brains integrate information across sensory modalities to generate perceptual experiences and form memories. However, it is difficult to determine the conditions under which multisensory stimulation will benefit or hinder the retrieval of everyday experiences. We hypothesized that the determining factor is the reliability of information processing during stimulus presentation, which can be measured through intersubject correlation of stimulus-evoked activity. We therefore presented biographical auditory narratives and visual animations to 72 human subjects visually, auditorily, or combined, while neural activity was recorded using electroencephalography. Memory for the narrated information, contained in the auditory stream, was tested 3 weeks later. While the visual stimulus alone led to no meaningful retrieval, this related stimulus improved memory when it was combined with the story, even when it was temporally incongruent with the audio. Further, individuals with better subsequent memory elicited neural responses during encoding that were more correlated with their peers. Surprisingly, portions of this predictive synchronized activity were present regardless of the sensory modality of the stimulus. These data suggest that the strength of sensory and supramodal activity is predictive of memory performance after 3 weeks, and that neural synchrony may explain the mnemonic benefit of the functionally uninformative visual context observed for these real-world stimuli.
format Online
Article
Text
id pubmed-5103161
institution National Center for Biotechnology Information
language English
publishDate 2016
publisher Society for Neuroscience
record_format MEDLINE/PubMed
spelling pubmed-51031612016-11-14 Memorable Audiovisual Narratives Synchronize Sensory and Supramodal Neural Responses Cohen, Samantha S. Parra, Lucas C. eNeuro New Research Our brains integrate information across sensory modalities to generate perceptual experiences and form memories. However, it is difficult to determine the conditions under which multisensory stimulation will benefit or hinder the retrieval of everyday experiences. We hypothesized that the determining factor is the reliability of information processing during stimulus presentation, which can be measured through intersubject correlation of stimulus-evoked activity. We therefore presented biographical auditory narratives and visual animations to 72 human subjects visually, auditorily, or combined, while neural activity was recorded using electroencephalography. Memory for the narrated information, contained in the auditory stream, was tested 3 weeks later. While the visual stimulus alone led to no meaningful retrieval, this related stimulus improved memory when it was combined with the story, even when it was temporally incongruent with the audio. Further, individuals with better subsequent memory elicited neural responses during encoding that were more correlated with their peers. Surprisingly, portions of this predictive synchronized activity were present regardless of the sensory modality of the stimulus. These data suggest that the strength of sensory and supramodal activity is predictive of memory performance after 3 weeks, and that neural synchrony may explain the mnemonic benefit of the functionally uninformative visual context observed for these real-world stimuli. Society for Neuroscience 2016-11-10 /pmc/articles/PMC5103161/ /pubmed/27844062 http://dx.doi.org/10.1523/ENEURO.0203-16.2016 Text en Copyright © 2016 Cohen and Parra http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution 4.0 International (http://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution and reproduction in any medium provided that the original work is properly attributed.
spellingShingle New Research
Cohen, Samantha S.
Parra, Lucas C.
Memorable Audiovisual Narratives Synchronize Sensory and Supramodal Neural Responses
title Memorable Audiovisual Narratives Synchronize Sensory and Supramodal Neural Responses
title_full Memorable Audiovisual Narratives Synchronize Sensory and Supramodal Neural Responses
title_fullStr Memorable Audiovisual Narratives Synchronize Sensory and Supramodal Neural Responses
title_full_unstemmed Memorable Audiovisual Narratives Synchronize Sensory and Supramodal Neural Responses
title_short Memorable Audiovisual Narratives Synchronize Sensory and Supramodal Neural Responses
title_sort memorable audiovisual narratives synchronize sensory and supramodal neural responses
topic New Research
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5103161/
https://www.ncbi.nlm.nih.gov/pubmed/27844062
http://dx.doi.org/10.1523/ENEURO.0203-16.2016
work_keys_str_mv AT cohensamanthas memorableaudiovisualnarrativessynchronizesensoryandsupramodalneuralresponses
AT parralucasc memorableaudiovisualnarrativessynchronizesensoryandsupramodalneuralresponses