Cargando…

DAVID: An open-source platform for real-time transformation of infra-segmental emotional cues in running speech

We present an open-source software platform that transforms emotional cues expressed by speech signals using audio effects like pitch shifting, inflection, vibrato, and filtering. The emotional transformations can be applied to any audio file, but can also run in real time, using live input from a m...

Descripción completa

Detalles Bibliográficos
Autores principales: Rachman, Laura, Liuni, Marco, Arias, Pablo, Lind, Andreas, Johansson, Petter, Hall, Lars, Richardson, Daniel, Watanabe, Katsumi, Dubal, Stéphanie, Aucouturier, Jean-Julien
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer US 2017
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5809549/
https://www.ncbi.nlm.nih.gov/pubmed/28374144
http://dx.doi.org/10.3758/s13428-017-0873-y
_version_ 1783299584093585408
author Rachman, Laura
Liuni, Marco
Arias, Pablo
Lind, Andreas
Johansson, Petter
Hall, Lars
Richardson, Daniel
Watanabe, Katsumi
Dubal, Stéphanie
Aucouturier, Jean-Julien
author_facet Rachman, Laura
Liuni, Marco
Arias, Pablo
Lind, Andreas
Johansson, Petter
Hall, Lars
Richardson, Daniel
Watanabe, Katsumi
Dubal, Stéphanie
Aucouturier, Jean-Julien
author_sort Rachman, Laura
collection PubMed
description We present an open-source software platform that transforms emotional cues expressed by speech signals using audio effects like pitch shifting, inflection, vibrato, and filtering. The emotional transformations can be applied to any audio file, but can also run in real time, using live input from a microphone, with less than 20-ms latency. We anticipate that this tool will be useful for the study of emotions in psychology and neuroscience, because it enables a high level of control over the acoustical and emotional content of experimental stimuli in a variety of laboratory situations, including real-time social situations. We present here results of a series of validation experiments aiming to position the tool against several methodological requirements: that transformed emotions be recognized at above-chance levels, valid in several languages (French, English, Swedish, and Japanese) and with a naturalness comparable to natural speech.
format Online
Article
Text
id pubmed-5809549
institution National Center for Biotechnology Information
language English
publishDate 2017
publisher Springer US
record_format MEDLINE/PubMed
spelling pubmed-58095492018-02-22 DAVID: An open-source platform for real-time transformation of infra-segmental emotional cues in running speech Rachman, Laura Liuni, Marco Arias, Pablo Lind, Andreas Johansson, Petter Hall, Lars Richardson, Daniel Watanabe, Katsumi Dubal, Stéphanie Aucouturier, Jean-Julien Behav Res Methods Article We present an open-source software platform that transforms emotional cues expressed by speech signals using audio effects like pitch shifting, inflection, vibrato, and filtering. The emotional transformations can be applied to any audio file, but can also run in real time, using live input from a microphone, with less than 20-ms latency. We anticipate that this tool will be useful for the study of emotions in psychology and neuroscience, because it enables a high level of control over the acoustical and emotional content of experimental stimuli in a variety of laboratory situations, including real-time social situations. We present here results of a series of validation experiments aiming to position the tool against several methodological requirements: that transformed emotions be recognized at above-chance levels, valid in several languages (French, English, Swedish, and Japanese) and with a naturalness comparable to natural speech. Springer US 2017-04-03 2018 /pmc/articles/PMC5809549/ /pubmed/28374144 http://dx.doi.org/10.3758/s13428-017-0873-y Text en © The Author(s) 2017 https://creativecommons.org/licenses/by/4.0/This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) ), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
spellingShingle Article
Rachman, Laura
Liuni, Marco
Arias, Pablo
Lind, Andreas
Johansson, Petter
Hall, Lars
Richardson, Daniel
Watanabe, Katsumi
Dubal, Stéphanie
Aucouturier, Jean-Julien
DAVID: An open-source platform for real-time transformation of infra-segmental emotional cues in running speech
title DAVID: An open-source platform for real-time transformation of infra-segmental emotional cues in running speech
title_full DAVID: An open-source platform for real-time transformation of infra-segmental emotional cues in running speech
title_fullStr DAVID: An open-source platform for real-time transformation of infra-segmental emotional cues in running speech
title_full_unstemmed DAVID: An open-source platform for real-time transformation of infra-segmental emotional cues in running speech
title_short DAVID: An open-source platform for real-time transformation of infra-segmental emotional cues in running speech
title_sort david: an open-source platform for real-time transformation of infra-segmental emotional cues in running speech
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5809549/
https://www.ncbi.nlm.nih.gov/pubmed/28374144
http://dx.doi.org/10.3758/s13428-017-0873-y
work_keys_str_mv AT rachmanlaura davidanopensourceplatformforrealtimetransformationofinfrasegmentalemotionalcuesinrunningspeech
AT liunimarco davidanopensourceplatformforrealtimetransformationofinfrasegmentalemotionalcuesinrunningspeech
AT ariaspablo davidanopensourceplatformforrealtimetransformationofinfrasegmentalemotionalcuesinrunningspeech
AT lindandreas davidanopensourceplatformforrealtimetransformationofinfrasegmentalemotionalcuesinrunningspeech
AT johanssonpetter davidanopensourceplatformforrealtimetransformationofinfrasegmentalemotionalcuesinrunningspeech
AT halllars davidanopensourceplatformforrealtimetransformationofinfrasegmentalemotionalcuesinrunningspeech
AT richardsondaniel davidanopensourceplatformforrealtimetransformationofinfrasegmentalemotionalcuesinrunningspeech
AT watanabekatsumi davidanopensourceplatformforrealtimetransformationofinfrasegmentalemotionalcuesinrunningspeech
AT dubalstephanie davidanopensourceplatformforrealtimetransformationofinfrasegmentalemotionalcuesinrunningspeech
AT aucouturierjeanjulien davidanopensourceplatformforrealtimetransformationofinfrasegmentalemotionalcuesinrunningspeech