Cargando…

A hierarchy of linguistic predictions during natural language comprehension

Understanding spoken language requires transforming ambiguous acoustic streams into a hierarchy of representations, from phonemes to meaning. It has been suggested that the brain uses prediction to guide the interpretation of incoming input. However, the role of prediction in language processing rem...

Descripción completa

Detalles Bibliográficos
Autores principales: Heilbron, Micha, Armeni, Kristijan, Schoffelen, Jan-Mathijs, Hagoort, Peter, de Lange, Floris P.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: National Academy of Sciences 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9371745/
https://www.ncbi.nlm.nih.gov/pubmed/35921434
http://dx.doi.org/10.1073/pnas.2201968119
_version_ 1784767225183338496
author Heilbron, Micha
Armeni, Kristijan
Schoffelen, Jan-Mathijs
Hagoort, Peter
de Lange, Floris P.
author_facet Heilbron, Micha
Armeni, Kristijan
Schoffelen, Jan-Mathijs
Hagoort, Peter
de Lange, Floris P.
author_sort Heilbron, Micha
collection PubMed
description Understanding spoken language requires transforming ambiguous acoustic streams into a hierarchy of representations, from phonemes to meaning. It has been suggested that the brain uses prediction to guide the interpretation of incoming input. However, the role of prediction in language processing remains disputed, with disagreement about both the ubiquity and representational nature of predictions. Here, we address both issues by analyzing brain recordings of participants listening to audiobooks, and using a deep neural network (GPT-2) to precisely quantify contextual predictions. First, we establish that brain responses to words are modulated by ubiquitous predictions. Next, we disentangle model-based predictions into distinct dimensions, revealing dissociable neural signatures of predictions about syntactic category (parts of speech), phonemes, and semantics. Finally, we show that high-level (word) predictions inform low-level (phoneme) predictions, supporting hierarchical predictive processing. Together, these results underscore the ubiquity of prediction in language processing, showing that the brain spontaneously predicts upcoming language at multiple levels of abstraction.
format Online
Article
Text
id pubmed-9371745
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher National Academy of Sciences
record_format MEDLINE/PubMed
spelling pubmed-93717452023-02-03 A hierarchy of linguistic predictions during natural language comprehension Heilbron, Micha Armeni, Kristijan Schoffelen, Jan-Mathijs Hagoort, Peter de Lange, Floris P. Proc Natl Acad Sci U S A Biological Sciences Understanding spoken language requires transforming ambiguous acoustic streams into a hierarchy of representations, from phonemes to meaning. It has been suggested that the brain uses prediction to guide the interpretation of incoming input. However, the role of prediction in language processing remains disputed, with disagreement about both the ubiquity and representational nature of predictions. Here, we address both issues by analyzing brain recordings of participants listening to audiobooks, and using a deep neural network (GPT-2) to precisely quantify contextual predictions. First, we establish that brain responses to words are modulated by ubiquitous predictions. Next, we disentangle model-based predictions into distinct dimensions, revealing dissociable neural signatures of predictions about syntactic category (parts of speech), phonemes, and semantics. Finally, we show that high-level (word) predictions inform low-level (phoneme) predictions, supporting hierarchical predictive processing. Together, these results underscore the ubiquity of prediction in language processing, showing that the brain spontaneously predicts upcoming language at multiple levels of abstraction. National Academy of Sciences 2022-08-03 2022-08-09 /pmc/articles/PMC9371745/ /pubmed/35921434 http://dx.doi.org/10.1073/pnas.2201968119 Text en Copyright © 2022 the Author(s). Published by PNAS. https://creativecommons.org/licenses/by-nc-nd/4.0/This article is distributed under Creative Commons Attribution-NonCommercial-NoDerivatives License 4.0 (CC BY-NC-ND) (https://creativecommons.org/licenses/by-nc-nd/4.0/) .
spellingShingle Biological Sciences
Heilbron, Micha
Armeni, Kristijan
Schoffelen, Jan-Mathijs
Hagoort, Peter
de Lange, Floris P.
A hierarchy of linguistic predictions during natural language comprehension
title A hierarchy of linguistic predictions during natural language comprehension
title_full A hierarchy of linguistic predictions during natural language comprehension
title_fullStr A hierarchy of linguistic predictions during natural language comprehension
title_full_unstemmed A hierarchy of linguistic predictions during natural language comprehension
title_short A hierarchy of linguistic predictions during natural language comprehension
title_sort hierarchy of linguistic predictions during natural language comprehension
topic Biological Sciences
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9371745/
https://www.ncbi.nlm.nih.gov/pubmed/35921434
http://dx.doi.org/10.1073/pnas.2201968119
work_keys_str_mv AT heilbronmicha ahierarchyoflinguisticpredictionsduringnaturallanguagecomprehension
AT armenikristijan ahierarchyoflinguisticpredictionsduringnaturallanguagecomprehension
AT schoffelenjanmathijs ahierarchyoflinguisticpredictionsduringnaturallanguagecomprehension
AT hagoortpeter ahierarchyoflinguisticpredictionsduringnaturallanguagecomprehension
AT delangeflorisp ahierarchyoflinguisticpredictionsduringnaturallanguagecomprehension
AT heilbronmicha hierarchyoflinguisticpredictionsduringnaturallanguagecomprehension
AT armenikristijan hierarchyoflinguisticpredictionsduringnaturallanguagecomprehension
AT schoffelenjanmathijs hierarchyoflinguisticpredictionsduringnaturallanguagecomprehension
AT hagoortpeter hierarchyoflinguisticpredictionsduringnaturallanguagecomprehension
AT delangeflorisp hierarchyoflinguisticpredictionsduringnaturallanguagecomprehension