Cargando…

Natural language processing models reveal neural dynamics of human conversation

Human verbal communication requires a rapid interplay between speech planning, production, and comprehension. These processes are subserved by local and long-range neural dynamics across widely distributed brain areas. How linguistic information is precisely represented during natural conversation o...

Descripción completa

Detalles Bibliográficos
Autores principales: Cai, Jing, Hadjinicolaou, Alex E., Paulk, Angelique C., Williams, Ziv M., Cash, Sydney S.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Cold Spring Harbor Laboratory 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10028965/
https://www.ncbi.nlm.nih.gov/pubmed/36945468
http://dx.doi.org/10.1101/2023.03.10.531095
_version_ 1784910051401531392
author Cai, Jing
Hadjinicolaou, Alex E.
Paulk, Angelique C.
Williams, Ziv M.
Cash, Sydney S.
author_facet Cai, Jing
Hadjinicolaou, Alex E.
Paulk, Angelique C.
Williams, Ziv M.
Cash, Sydney S.
author_sort Cai, Jing
collection PubMed
description Human verbal communication requires a rapid interplay between speech planning, production, and comprehension. These processes are subserved by local and long-range neural dynamics across widely distributed brain areas. How linguistic information is precisely represented during natural conversation or what shared neural processes are involved, however, remain largely unknown. Here we used intracranial neural recordings in participants engaged in free dialogue and employed deep learning natural language processing models to find a striking similarity not only between neural-to-artificial network activities but also between how linguistic information is encoded in brain during production and comprehension. Collectively, neural activity patterns that encoded linguistic information were closely aligned to those reflecting speaker-listener transitions and were reduced after word utterance or when no conversation was held. They were also observed across distinct mesoscopic areas and frequency bands during production and comprehension, suggesting that these signals reflected the hierarchically structured information being conveyed during dialogue. Together, these findings suggest that linguistic information is encoded in the brain through similar neural representations during both speaking and listening, and start to reveal the distributed neural dynamics subserving human communication.
format Online
Article
Text
id pubmed-10028965
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Cold Spring Harbor Laboratory
record_format MEDLINE/PubMed
spelling pubmed-100289652023-03-22 Natural language processing models reveal neural dynamics of human conversation Cai, Jing Hadjinicolaou, Alex E. Paulk, Angelique C. Williams, Ziv M. Cash, Sydney S. bioRxiv Article Human verbal communication requires a rapid interplay between speech planning, production, and comprehension. These processes are subserved by local and long-range neural dynamics across widely distributed brain areas. How linguistic information is precisely represented during natural conversation or what shared neural processes are involved, however, remain largely unknown. Here we used intracranial neural recordings in participants engaged in free dialogue and employed deep learning natural language processing models to find a striking similarity not only between neural-to-artificial network activities but also between how linguistic information is encoded in brain during production and comprehension. Collectively, neural activity patterns that encoded linguistic information were closely aligned to those reflecting speaker-listener transitions and were reduced after word utterance or when no conversation was held. They were also observed across distinct mesoscopic areas and frequency bands during production and comprehension, suggesting that these signals reflected the hierarchically structured information being conveyed during dialogue. Together, these findings suggest that linguistic information is encoded in the brain through similar neural representations during both speaking and listening, and start to reveal the distributed neural dynamics subserving human communication. Cold Spring Harbor Laboratory 2023-03-11 /pmc/articles/PMC10028965/ /pubmed/36945468 http://dx.doi.org/10.1101/2023.03.10.531095 Text en https://creativecommons.org/licenses/by-nd/4.0/This work is licensed under a Creative Commons Attribution-NoDerivatives 4.0 International License (https://creativecommons.org/licenses/by-nd/4.0/) , which allows reusers to copy and distribute the material in any medium or format in unadapted form only, and only so long as attribution is given to the creator. The license allows for commercial use.
spellingShingle Article
Cai, Jing
Hadjinicolaou, Alex E.
Paulk, Angelique C.
Williams, Ziv M.
Cash, Sydney S.
Natural language processing models reveal neural dynamics of human conversation
title Natural language processing models reveal neural dynamics of human conversation
title_full Natural language processing models reveal neural dynamics of human conversation
title_fullStr Natural language processing models reveal neural dynamics of human conversation
title_full_unstemmed Natural language processing models reveal neural dynamics of human conversation
title_short Natural language processing models reveal neural dynamics of human conversation
title_sort natural language processing models reveal neural dynamics of human conversation
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10028965/
https://www.ncbi.nlm.nih.gov/pubmed/36945468
http://dx.doi.org/10.1101/2023.03.10.531095
work_keys_str_mv AT caijing naturallanguageprocessingmodelsrevealneuraldynamicsofhumanconversation
AT hadjinicolaoualexe naturallanguageprocessingmodelsrevealneuraldynamicsofhumanconversation
AT paulkangeliquec naturallanguageprocessingmodelsrevealneuraldynamicsofhumanconversation
AT williamszivm naturallanguageprocessingmodelsrevealneuraldynamicsofhumanconversation
AT cashsydneys naturallanguageprocessingmodelsrevealneuraldynamicsofhumanconversation