Cargando…

Automatic speaker diarization for natural conversation analysis in autism clinical trials

Challenges in social communication is one of the core symptom domains in autism spectrum disorder (ASD). Novel therapies are under development to help individuals with these challenges, however the ability to show a benefit is dependent on a sensitive and reliable measure of treatment effect. Curren...

Descripción completa

Detalles Bibliográficos
Autores principales: O’Sullivan, James, Bogaarts, Guy, Schoenenberger, Philipp, Tillmann, Julian, Slater, David, Mesgarani, Nima, Eule, Eckhart, Kilchenmann, Timothy, Murtagh, Lorraine, Hipp, Joerg, Lindemann, Michael, Lipsmeier, Florian, Cheng, Wei-Yi, Nobbs, David, Chatham, Christopher
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10290724/
https://www.ncbi.nlm.nih.gov/pubmed/37355730
http://dx.doi.org/10.1038/s41598-023-36701-4
_version_ 1785062552925896704
author O’Sullivan, James
Bogaarts, Guy
Schoenenberger, Philipp
Tillmann, Julian
Slater, David
Mesgarani, Nima
Eule, Eckhart
Kilchenmann, Timothy
Murtagh, Lorraine
Hipp, Joerg
Lindemann, Michael
Lipsmeier, Florian
Cheng, Wei-Yi
Nobbs, David
Chatham, Christopher
author_facet O’Sullivan, James
Bogaarts, Guy
Schoenenberger, Philipp
Tillmann, Julian
Slater, David
Mesgarani, Nima
Eule, Eckhart
Kilchenmann, Timothy
Murtagh, Lorraine
Hipp, Joerg
Lindemann, Michael
Lipsmeier, Florian
Cheng, Wei-Yi
Nobbs, David
Chatham, Christopher
author_sort O’Sullivan, James
collection PubMed
description Challenges in social communication is one of the core symptom domains in autism spectrum disorder (ASD). Novel therapies are under development to help individuals with these challenges, however the ability to show a benefit is dependent on a sensitive and reliable measure of treatment effect. Currently, measuring these deficits requires the use of time-consuming and subjective techniques. Objective measures extracted from natural conversations could be more ecologically relevant, and administered more frequently—perhaps giving them added sensitivity to change. While several studies have used automated analysis methods to study autistic speech, they require manual transcriptions. In order to bypass this time-consuming process, an automated speaker diarization algorithm must first be applied. In this paper, we are testing whether a speaker diarization algorithm can be applied to natural conversations between autistic individuals and their conversational partner in a natural setting at home over the course of a clinical trial. We calculated the average duration that a participant would speak for within their turn. We found a significant correlation between this feature and the Vineland Adaptive Behaviour Scales (VABS) expressive communication score (r = 0.51, p = 7 × 10(–5)). Our results show that natural conversations can be used to obtain measures of talkativeness, and that this measure can be derived automatically, thus showing the promise of objectively evaluating communication challenges in ASD.
format Online
Article
Text
id pubmed-10290724
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-102907242023-06-26 Automatic speaker diarization for natural conversation analysis in autism clinical trials O’Sullivan, James Bogaarts, Guy Schoenenberger, Philipp Tillmann, Julian Slater, David Mesgarani, Nima Eule, Eckhart Kilchenmann, Timothy Murtagh, Lorraine Hipp, Joerg Lindemann, Michael Lipsmeier, Florian Cheng, Wei-Yi Nobbs, David Chatham, Christopher Sci Rep Article Challenges in social communication is one of the core symptom domains in autism spectrum disorder (ASD). Novel therapies are under development to help individuals with these challenges, however the ability to show a benefit is dependent on a sensitive and reliable measure of treatment effect. Currently, measuring these deficits requires the use of time-consuming and subjective techniques. Objective measures extracted from natural conversations could be more ecologically relevant, and administered more frequently—perhaps giving them added sensitivity to change. While several studies have used automated analysis methods to study autistic speech, they require manual transcriptions. In order to bypass this time-consuming process, an automated speaker diarization algorithm must first be applied. In this paper, we are testing whether a speaker diarization algorithm can be applied to natural conversations between autistic individuals and their conversational partner in a natural setting at home over the course of a clinical trial. We calculated the average duration that a participant would speak for within their turn. We found a significant correlation between this feature and the Vineland Adaptive Behaviour Scales (VABS) expressive communication score (r = 0.51, p = 7 × 10(–5)). Our results show that natural conversations can be used to obtain measures of talkativeness, and that this measure can be derived automatically, thus showing the promise of objectively evaluating communication challenges in ASD. Nature Publishing Group UK 2023-06-24 /pmc/articles/PMC10290724/ /pubmed/37355730 http://dx.doi.org/10.1038/s41598-023-36701-4 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
O’Sullivan, James
Bogaarts, Guy
Schoenenberger, Philipp
Tillmann, Julian
Slater, David
Mesgarani, Nima
Eule, Eckhart
Kilchenmann, Timothy
Murtagh, Lorraine
Hipp, Joerg
Lindemann, Michael
Lipsmeier, Florian
Cheng, Wei-Yi
Nobbs, David
Chatham, Christopher
Automatic speaker diarization for natural conversation analysis in autism clinical trials
title Automatic speaker diarization for natural conversation analysis in autism clinical trials
title_full Automatic speaker diarization for natural conversation analysis in autism clinical trials
title_fullStr Automatic speaker diarization for natural conversation analysis in autism clinical trials
title_full_unstemmed Automatic speaker diarization for natural conversation analysis in autism clinical trials
title_short Automatic speaker diarization for natural conversation analysis in autism clinical trials
title_sort automatic speaker diarization for natural conversation analysis in autism clinical trials
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10290724/
https://www.ncbi.nlm.nih.gov/pubmed/37355730
http://dx.doi.org/10.1038/s41598-023-36701-4
work_keys_str_mv AT osullivanjames automaticspeakerdiarizationfornaturalconversationanalysisinautismclinicaltrials
AT bogaartsguy automaticspeakerdiarizationfornaturalconversationanalysisinautismclinicaltrials
AT schoenenbergerphilipp automaticspeakerdiarizationfornaturalconversationanalysisinautismclinicaltrials
AT tillmannjulian automaticspeakerdiarizationfornaturalconversationanalysisinautismclinicaltrials
AT slaterdavid automaticspeakerdiarizationfornaturalconversationanalysisinautismclinicaltrials
AT mesgaraninima automaticspeakerdiarizationfornaturalconversationanalysisinautismclinicaltrials
AT euleeckhart automaticspeakerdiarizationfornaturalconversationanalysisinautismclinicaltrials
AT kilchenmanntimothy automaticspeakerdiarizationfornaturalconversationanalysisinautismclinicaltrials
AT murtaghlorraine automaticspeakerdiarizationfornaturalconversationanalysisinautismclinicaltrials
AT hippjoerg automaticspeakerdiarizationfornaturalconversationanalysisinautismclinicaltrials
AT lindemannmichael automaticspeakerdiarizationfornaturalconversationanalysisinautismclinicaltrials
AT lipsmeierflorian automaticspeakerdiarizationfornaturalconversationanalysisinautismclinicaltrials
AT chengweiyi automaticspeakerdiarizationfornaturalconversationanalysisinautismclinicaltrials
AT nobbsdavid automaticspeakerdiarizationfornaturalconversationanalysisinautismclinicaltrials
AT chathamchristopher automaticspeakerdiarizationfornaturalconversationanalysisinautismclinicaltrials