Cargando…

The effects of data quantity on performance of temporal response function analyses of natural speech processing

In recent years, temporal response function (TRF) analyses of neural activity recordings evoked by continuous naturalistic stimuli have become increasingly popular for characterizing response properties within the auditory hierarchy. However, despite this rise in TRF usage, relatively few educationa...

Descripción completa

Detalles Bibliográficos
Autores principales: Mesik, Juraj, Wojtczak, Magdalena
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9878558/
https://www.ncbi.nlm.nih.gov/pubmed/36711133
http://dx.doi.org/10.3389/fnins.2022.963629
_version_ 1784878511657320448
author Mesik, Juraj
Wojtczak, Magdalena
author_facet Mesik, Juraj
Wojtczak, Magdalena
author_sort Mesik, Juraj
collection PubMed
description In recent years, temporal response function (TRF) analyses of neural activity recordings evoked by continuous naturalistic stimuli have become increasingly popular for characterizing response properties within the auditory hierarchy. However, despite this rise in TRF usage, relatively few educational resources for these tools exist. Here we use a dual-talker continuous speech paradigm to demonstrate how a key parameter of experimental design, the quantity of acquired data, influences TRF analyses fit to either individual data (subject-specific analyses), or group data (generic analyses). We show that although model prediction accuracy increases monotonically with data quantity, the amount of data required to achieve significant prediction accuracies can vary substantially based on whether the fitted model contains densely (e.g., acoustic envelope) or sparsely (e.g., lexical surprisal) spaced features, especially when the goal of the analyses is to capture the aspect of neural responses uniquely explained by specific features. Moreover, we demonstrate that generic models can exhibit high performance on small amounts of test data (2–8 min), if they are trained on a sufficiently large data set. As such, they may be particularly useful for clinical and multi-task study designs with limited recording time. Finally, we show that the regularization procedure used in fitting TRF models can interact with the quantity of data used to fit the models, with larger training quantities resulting in systematically larger TRF amplitudes. Together, demonstrations in this work should aid new users of TRF analyses, and in combination with other tools, such as piloting and power analyses, may serve as a detailed reference for choosing acquisition duration in future studies.
format Online
Article
Text
id pubmed-9878558
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-98785582023-01-27 The effects of data quantity on performance of temporal response function analyses of natural speech processing Mesik, Juraj Wojtczak, Magdalena Front Neurosci Neuroscience In recent years, temporal response function (TRF) analyses of neural activity recordings evoked by continuous naturalistic stimuli have become increasingly popular for characterizing response properties within the auditory hierarchy. However, despite this rise in TRF usage, relatively few educational resources for these tools exist. Here we use a dual-talker continuous speech paradigm to demonstrate how a key parameter of experimental design, the quantity of acquired data, influences TRF analyses fit to either individual data (subject-specific analyses), or group data (generic analyses). We show that although model prediction accuracy increases monotonically with data quantity, the amount of data required to achieve significant prediction accuracies can vary substantially based on whether the fitted model contains densely (e.g., acoustic envelope) or sparsely (e.g., lexical surprisal) spaced features, especially when the goal of the analyses is to capture the aspect of neural responses uniquely explained by specific features. Moreover, we demonstrate that generic models can exhibit high performance on small amounts of test data (2–8 min), if they are trained on a sufficiently large data set. As such, they may be particularly useful for clinical and multi-task study designs with limited recording time. Finally, we show that the regularization procedure used in fitting TRF models can interact with the quantity of data used to fit the models, with larger training quantities resulting in systematically larger TRF amplitudes. Together, demonstrations in this work should aid new users of TRF analyses, and in combination with other tools, such as piloting and power analyses, may serve as a detailed reference for choosing acquisition duration in future studies. Frontiers Media S.A. 2023-01-12 /pmc/articles/PMC9878558/ /pubmed/36711133 http://dx.doi.org/10.3389/fnins.2022.963629 Text en Copyright © 2023 Mesik and Wojtczak. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Mesik, Juraj
Wojtczak, Magdalena
The effects of data quantity on performance of temporal response function analyses of natural speech processing
title The effects of data quantity on performance of temporal response function analyses of natural speech processing
title_full The effects of data quantity on performance of temporal response function analyses of natural speech processing
title_fullStr The effects of data quantity on performance of temporal response function analyses of natural speech processing
title_full_unstemmed The effects of data quantity on performance of temporal response function analyses of natural speech processing
title_short The effects of data quantity on performance of temporal response function analyses of natural speech processing
title_sort effects of data quantity on performance of temporal response function analyses of natural speech processing
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9878558/
https://www.ncbi.nlm.nih.gov/pubmed/36711133
http://dx.doi.org/10.3389/fnins.2022.963629
work_keys_str_mv AT mesikjuraj theeffectsofdataquantityonperformanceoftemporalresponsefunctionanalysesofnaturalspeechprocessing
AT wojtczakmagdalena theeffectsofdataquantityonperformanceoftemporalresponsefunctionanalysesofnaturalspeechprocessing
AT mesikjuraj effectsofdataquantityonperformanceoftemporalresponsefunctionanalysesofnaturalspeechprocessing
AT wojtczakmagdalena effectsofdataquantityonperformanceoftemporalresponsefunctionanalysesofnaturalspeechprocessing