Cargando…

A shared linguistic space for transmitting our thoughts from brain to brain in natural conversations

Effective communication hinges on a mutual understanding of word meaning in different contexts. The embedding space learned by large language models can serve as an explicit model of the shared, context-rich meaning space humans use to communicate their thoughts. We recorded brain activity using ele...

Descripción completa

Detalles Bibliográficos
Autores principales: Zada, Zaid, Goldstein, Ariel, Michelmann, Sebastian, Simony, Erez, Price, Amy, Hasenfratz, Liat, Barham, Emily, Zadbood, Asieh, Doyle, Werner, Friedman, Daniel, Dugan, Patricia, Melloni, Lucia, Devore, Sasha, Flinker, Adeen, Devinsky, Orrin, Nastase, Samuel A., Hasson, Uri
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Cold Spring Harbor Laboratory 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10327051/
https://www.ncbi.nlm.nih.gov/pubmed/37425747
http://dx.doi.org/10.1101/2023.06.27.546708
_version_ 1785069548830982144
author Zada, Zaid
Goldstein, Ariel
Michelmann, Sebastian
Simony, Erez
Price, Amy
Hasenfratz, Liat
Barham, Emily
Zadbood, Asieh
Doyle, Werner
Friedman, Daniel
Dugan, Patricia
Melloni, Lucia
Devore, Sasha
Flinker, Adeen
Devinsky, Orrin
Nastase, Samuel A.
Hasson, Uri
author_facet Zada, Zaid
Goldstein, Ariel
Michelmann, Sebastian
Simony, Erez
Price, Amy
Hasenfratz, Liat
Barham, Emily
Zadbood, Asieh
Doyle, Werner
Friedman, Daniel
Dugan, Patricia
Melloni, Lucia
Devore, Sasha
Flinker, Adeen
Devinsky, Orrin
Nastase, Samuel A.
Hasson, Uri
author_sort Zada, Zaid
collection PubMed
description Effective communication hinges on a mutual understanding of word meaning in different contexts. The embedding space learned by large language models can serve as an explicit model of the shared, context-rich meaning space humans use to communicate their thoughts. We recorded brain activity using electrocorticography during spontaneous, face-to-face conversations in five pairs of epilepsy patients. We demonstrate that the linguistic embedding space can capture the linguistic content of word-by-word neural alignment between speaker and listener. Linguistic content emerged in the speaker’s brain before word articulation, and the same linguistic content rapidly reemerged in the listener’s brain after word articulation. These findings establish a computational framework to study how human brains transmit their thoughts to one another in real-world contexts.
format Online
Article
Text
id pubmed-10327051
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Cold Spring Harbor Laboratory
record_format MEDLINE/PubMed
spelling pubmed-103270512023-07-08 A shared linguistic space for transmitting our thoughts from brain to brain in natural conversations Zada, Zaid Goldstein, Ariel Michelmann, Sebastian Simony, Erez Price, Amy Hasenfratz, Liat Barham, Emily Zadbood, Asieh Doyle, Werner Friedman, Daniel Dugan, Patricia Melloni, Lucia Devore, Sasha Flinker, Adeen Devinsky, Orrin Nastase, Samuel A. Hasson, Uri bioRxiv Article Effective communication hinges on a mutual understanding of word meaning in different contexts. The embedding space learned by large language models can serve as an explicit model of the shared, context-rich meaning space humans use to communicate their thoughts. We recorded brain activity using electrocorticography during spontaneous, face-to-face conversations in five pairs of epilepsy patients. We demonstrate that the linguistic embedding space can capture the linguistic content of word-by-word neural alignment between speaker and listener. Linguistic content emerged in the speaker’s brain before word articulation, and the same linguistic content rapidly reemerged in the listener’s brain after word articulation. These findings establish a computational framework to study how human brains transmit their thoughts to one another in real-world contexts. Cold Spring Harbor Laboratory 2023-06-29 /pmc/articles/PMC10327051/ /pubmed/37425747 http://dx.doi.org/10.1101/2023.06.27.546708 Text en https://creativecommons.org/licenses/by-nd/4.0/This work is licensed under a Creative Commons Attribution-NoDerivatives 4.0 International License (https://creativecommons.org/licenses/by-nd/4.0/) , which allows reusers to copy and distribute the material in any medium or format in unadapted form only, and only so long as attribution is given to the creator. The license allows for commercial use.
spellingShingle Article
Zada, Zaid
Goldstein, Ariel
Michelmann, Sebastian
Simony, Erez
Price, Amy
Hasenfratz, Liat
Barham, Emily
Zadbood, Asieh
Doyle, Werner
Friedman, Daniel
Dugan, Patricia
Melloni, Lucia
Devore, Sasha
Flinker, Adeen
Devinsky, Orrin
Nastase, Samuel A.
Hasson, Uri
A shared linguistic space for transmitting our thoughts from brain to brain in natural conversations
title A shared linguistic space for transmitting our thoughts from brain to brain in natural conversations
title_full A shared linguistic space for transmitting our thoughts from brain to brain in natural conversations
title_fullStr A shared linguistic space for transmitting our thoughts from brain to brain in natural conversations
title_full_unstemmed A shared linguistic space for transmitting our thoughts from brain to brain in natural conversations
title_short A shared linguistic space for transmitting our thoughts from brain to brain in natural conversations
title_sort shared linguistic space for transmitting our thoughts from brain to brain in natural conversations
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10327051/
https://www.ncbi.nlm.nih.gov/pubmed/37425747
http://dx.doi.org/10.1101/2023.06.27.546708
work_keys_str_mv AT zadazaid asharedlinguisticspacefortransmittingourthoughtsfrombraintobraininnaturalconversations
AT goldsteinariel asharedlinguisticspacefortransmittingourthoughtsfrombraintobraininnaturalconversations
AT michelmannsebastian asharedlinguisticspacefortransmittingourthoughtsfrombraintobraininnaturalconversations
AT simonyerez asharedlinguisticspacefortransmittingourthoughtsfrombraintobraininnaturalconversations
AT priceamy asharedlinguisticspacefortransmittingourthoughtsfrombraintobraininnaturalconversations
AT hasenfratzliat asharedlinguisticspacefortransmittingourthoughtsfrombraintobraininnaturalconversations
AT barhamemily asharedlinguisticspacefortransmittingourthoughtsfrombraintobraininnaturalconversations
AT zadboodasieh asharedlinguisticspacefortransmittingourthoughtsfrombraintobraininnaturalconversations
AT doylewerner asharedlinguisticspacefortransmittingourthoughtsfrombraintobraininnaturalconversations
AT friedmandaniel asharedlinguisticspacefortransmittingourthoughtsfrombraintobraininnaturalconversations
AT duganpatricia asharedlinguisticspacefortransmittingourthoughtsfrombraintobraininnaturalconversations
AT mellonilucia asharedlinguisticspacefortransmittingourthoughtsfrombraintobraininnaturalconversations
AT devoresasha asharedlinguisticspacefortransmittingourthoughtsfrombraintobraininnaturalconversations
AT flinkeradeen asharedlinguisticspacefortransmittingourthoughtsfrombraintobraininnaturalconversations
AT devinskyorrin asharedlinguisticspacefortransmittingourthoughtsfrombraintobraininnaturalconversations
AT nastasesamuela asharedlinguisticspacefortransmittingourthoughtsfrombraintobraininnaturalconversations
AT hassonuri asharedlinguisticspacefortransmittingourthoughtsfrombraintobraininnaturalconversations
AT zadazaid sharedlinguisticspacefortransmittingourthoughtsfrombraintobraininnaturalconversations
AT goldsteinariel sharedlinguisticspacefortransmittingourthoughtsfrombraintobraininnaturalconversations
AT michelmannsebastian sharedlinguisticspacefortransmittingourthoughtsfrombraintobraininnaturalconversations
AT simonyerez sharedlinguisticspacefortransmittingourthoughtsfrombraintobraininnaturalconversations
AT priceamy sharedlinguisticspacefortransmittingourthoughtsfrombraintobraininnaturalconversations
AT hasenfratzliat sharedlinguisticspacefortransmittingourthoughtsfrombraintobraininnaturalconversations
AT barhamemily sharedlinguisticspacefortransmittingourthoughtsfrombraintobraininnaturalconversations
AT zadboodasieh sharedlinguisticspacefortransmittingourthoughtsfrombraintobraininnaturalconversations
AT doylewerner sharedlinguisticspacefortransmittingourthoughtsfrombraintobraininnaturalconversations
AT friedmandaniel sharedlinguisticspacefortransmittingourthoughtsfrombraintobraininnaturalconversations
AT duganpatricia sharedlinguisticspacefortransmittingourthoughtsfrombraintobraininnaturalconversations
AT mellonilucia sharedlinguisticspacefortransmittingourthoughtsfrombraintobraininnaturalconversations
AT devoresasha sharedlinguisticspacefortransmittingourthoughtsfrombraintobraininnaturalconversations
AT flinkeradeen sharedlinguisticspacefortransmittingourthoughtsfrombraintobraininnaturalconversations
AT devinskyorrin sharedlinguisticspacefortransmittingourthoughtsfrombraintobraininnaturalconversations
AT nastasesamuela sharedlinguisticspacefortransmittingourthoughtsfrombraintobraininnaturalconversations
AT hassonuri sharedlinguisticspacefortransmittingourthoughtsfrombraintobraininnaturalconversations