Cargando…

Music can be reconstructed from human auditory cortex activity using nonlinear decoding models

Music is core to human experience, yet the precise neural dynamics underlying music perception remain unknown. We analyzed a unique intracranial electroencephalography (iEEG) dataset of 29 patients who listened to a Pink Floyd song and applied a stimulus reconstruction approach previously used in th...

Descripción completa

Detalles Bibliográficos
Autores principales: Bellier, Ludovic, Llorens, Anaïs, Marciano, Déborah, Gunduz, Aysegul, Schalk, Gerwin, Brunner, Peter, Knight, Robert T.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10427021/
https://www.ncbi.nlm.nih.gov/pubmed/37582062
http://dx.doi.org/10.1371/journal.pbio.3002176
_version_ 1785090160768057344
author Bellier, Ludovic
Llorens, Anaïs
Marciano, Déborah
Gunduz, Aysegul
Schalk, Gerwin
Brunner, Peter
Knight, Robert T.
author_facet Bellier, Ludovic
Llorens, Anaïs
Marciano, Déborah
Gunduz, Aysegul
Schalk, Gerwin
Brunner, Peter
Knight, Robert T.
author_sort Bellier, Ludovic
collection PubMed
description Music is core to human experience, yet the precise neural dynamics underlying music perception remain unknown. We analyzed a unique intracranial electroencephalography (iEEG) dataset of 29 patients who listened to a Pink Floyd song and applied a stimulus reconstruction approach previously used in the speech domain. We successfully reconstructed a recognizable song from direct neural recordings and quantified the impact of different factors on decoding accuracy. Combining encoding and decoding analyses, we found a right-hemisphere dominance for music perception with a primary role of the superior temporal gyrus (STG), evidenced a new STG subregion tuned to musical rhythm, and defined an anterior–posterior STG organization exhibiting sustained and onset responses to musical elements. Our findings show the feasibility of applying predictive modeling on short datasets acquired in single patients, paving the way for adding musical elements to brain–computer interface (BCI) applications.
format Online
Article
Text
id pubmed-10427021
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-104270212023-08-16 Music can be reconstructed from human auditory cortex activity using nonlinear decoding models Bellier, Ludovic Llorens, Anaïs Marciano, Déborah Gunduz, Aysegul Schalk, Gerwin Brunner, Peter Knight, Robert T. PLoS Biol Research Article Music is core to human experience, yet the precise neural dynamics underlying music perception remain unknown. We analyzed a unique intracranial electroencephalography (iEEG) dataset of 29 patients who listened to a Pink Floyd song and applied a stimulus reconstruction approach previously used in the speech domain. We successfully reconstructed a recognizable song from direct neural recordings and quantified the impact of different factors on decoding accuracy. Combining encoding and decoding analyses, we found a right-hemisphere dominance for music perception with a primary role of the superior temporal gyrus (STG), evidenced a new STG subregion tuned to musical rhythm, and defined an anterior–posterior STG organization exhibiting sustained and onset responses to musical elements. Our findings show the feasibility of applying predictive modeling on short datasets acquired in single patients, paving the way for adding musical elements to brain–computer interface (BCI) applications. Public Library of Science 2023-08-15 /pmc/articles/PMC10427021/ /pubmed/37582062 http://dx.doi.org/10.1371/journal.pbio.3002176 Text en © 2023 Bellier et al https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Research Article
Bellier, Ludovic
Llorens, Anaïs
Marciano, Déborah
Gunduz, Aysegul
Schalk, Gerwin
Brunner, Peter
Knight, Robert T.
Music can be reconstructed from human auditory cortex activity using nonlinear decoding models
title Music can be reconstructed from human auditory cortex activity using nonlinear decoding models
title_full Music can be reconstructed from human auditory cortex activity using nonlinear decoding models
title_fullStr Music can be reconstructed from human auditory cortex activity using nonlinear decoding models
title_full_unstemmed Music can be reconstructed from human auditory cortex activity using nonlinear decoding models
title_short Music can be reconstructed from human auditory cortex activity using nonlinear decoding models
title_sort music can be reconstructed from human auditory cortex activity using nonlinear decoding models
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10427021/
https://www.ncbi.nlm.nih.gov/pubmed/37582062
http://dx.doi.org/10.1371/journal.pbio.3002176
work_keys_str_mv AT bellierludovic musiccanbereconstructedfromhumanauditorycortexactivityusingnonlineardecodingmodels
AT llorensanais musiccanbereconstructedfromhumanauditorycortexactivityusingnonlineardecodingmodels
AT marcianodeborah musiccanbereconstructedfromhumanauditorycortexactivityusingnonlineardecodingmodels
AT gunduzaysegul musiccanbereconstructedfromhumanauditorycortexactivityusingnonlineardecodingmodels
AT schalkgerwin musiccanbereconstructedfromhumanauditorycortexactivityusingnonlineardecodingmodels
AT brunnerpeter musiccanbereconstructedfromhumanauditorycortexactivityusingnonlineardecodingmodels
AT knightrobertt musiccanbereconstructedfromhumanauditorycortexactivityusingnonlineardecodingmodels