Cargando…

Adding colour-realistic video images to audio playbacks increases stimulus engagement but does not enhance vocal learning in zebra finches

Bird song and human speech are learned early in life and for both cases engagement with live social tutors generally leads to better learning outcomes than passive audio-only exposure. Real-world tutor–tutee relations are normally not uni- but multimodal and observations suggest that visual cues rel...

Descripción completa

Detalles Bibliográficos
Autores principales: Varkevisser, Judith M., Simon, Ralph, Mendoza, Ezequiel, How, Martin, van Hijlkema, Idse, Jin, Rozanda, Liang, Qiaoyi, Scharff, Constance, Halfwerk, Wouter H., Riebel, Katharina
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer Berlin Heidelberg 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8940817/
https://www.ncbi.nlm.nih.gov/pubmed/34405288
http://dx.doi.org/10.1007/s10071-021-01547-8
_version_ 1784672980148682752
author Varkevisser, Judith M.
Simon, Ralph
Mendoza, Ezequiel
How, Martin
van Hijlkema, Idse
Jin, Rozanda
Liang, Qiaoyi
Scharff, Constance
Halfwerk, Wouter H.
Riebel, Katharina
author_facet Varkevisser, Judith M.
Simon, Ralph
Mendoza, Ezequiel
How, Martin
van Hijlkema, Idse
Jin, Rozanda
Liang, Qiaoyi
Scharff, Constance
Halfwerk, Wouter H.
Riebel, Katharina
author_sort Varkevisser, Judith M.
collection PubMed
description Bird song and human speech are learned early in life and for both cases engagement with live social tutors generally leads to better learning outcomes than passive audio-only exposure. Real-world tutor–tutee relations are normally not uni- but multimodal and observations suggest that visual cues related to sound production might enhance vocal learning. We tested this hypothesis by pairing appropriate, colour-realistic, high frame-rate videos of a singing adult male zebra finch tutor with song playbacks and presenting these stimuli to juvenile zebra finches (Taeniopygia guttata). Juveniles exposed to song playbacks combined with video presentation of a singing bird approached the stimulus more often and spent more time close to it than juveniles exposed to audio playback only or audio playback combined with pixelated and time-reversed videos. However, higher engagement with the realistic audio–visual stimuli was not predictive of better song learning. Thus, although multimodality increased stimulus engagement and biologically relevant video content was more salient than colour and movement equivalent videos, the higher engagement with the realistic audio–visual stimuli did not lead to enhanced vocal learning. Whether the lack of three-dimensionality of a video tutor and/or the lack of meaningful social interaction make them less suitable for facilitating song learning than audio–visual exposure to a live tutor remains to be tested. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1007/s10071-021-01547-8.
format Online
Article
Text
id pubmed-8940817
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Springer Berlin Heidelberg
record_format MEDLINE/PubMed
spelling pubmed-89408172022-04-07 Adding colour-realistic video images to audio playbacks increases stimulus engagement but does not enhance vocal learning in zebra finches Varkevisser, Judith M. Simon, Ralph Mendoza, Ezequiel How, Martin van Hijlkema, Idse Jin, Rozanda Liang, Qiaoyi Scharff, Constance Halfwerk, Wouter H. Riebel, Katharina Anim Cogn Original Paper Bird song and human speech are learned early in life and for both cases engagement with live social tutors generally leads to better learning outcomes than passive audio-only exposure. Real-world tutor–tutee relations are normally not uni- but multimodal and observations suggest that visual cues related to sound production might enhance vocal learning. We tested this hypothesis by pairing appropriate, colour-realistic, high frame-rate videos of a singing adult male zebra finch tutor with song playbacks and presenting these stimuli to juvenile zebra finches (Taeniopygia guttata). Juveniles exposed to song playbacks combined with video presentation of a singing bird approached the stimulus more often and spent more time close to it than juveniles exposed to audio playback only or audio playback combined with pixelated and time-reversed videos. However, higher engagement with the realistic audio–visual stimuli was not predictive of better song learning. Thus, although multimodality increased stimulus engagement and biologically relevant video content was more salient than colour and movement equivalent videos, the higher engagement with the realistic audio–visual stimuli did not lead to enhanced vocal learning. Whether the lack of three-dimensionality of a video tutor and/or the lack of meaningful social interaction make them less suitable for facilitating song learning than audio–visual exposure to a live tutor remains to be tested. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1007/s10071-021-01547-8. Springer Berlin Heidelberg 2021-08-17 2022 /pmc/articles/PMC8940817/ /pubmed/34405288 http://dx.doi.org/10.1007/s10071-021-01547-8 Text en © The Author(s) 2021 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Original Paper
Varkevisser, Judith M.
Simon, Ralph
Mendoza, Ezequiel
How, Martin
van Hijlkema, Idse
Jin, Rozanda
Liang, Qiaoyi
Scharff, Constance
Halfwerk, Wouter H.
Riebel, Katharina
Adding colour-realistic video images to audio playbacks increases stimulus engagement but does not enhance vocal learning in zebra finches
title Adding colour-realistic video images to audio playbacks increases stimulus engagement but does not enhance vocal learning in zebra finches
title_full Adding colour-realistic video images to audio playbacks increases stimulus engagement but does not enhance vocal learning in zebra finches
title_fullStr Adding colour-realistic video images to audio playbacks increases stimulus engagement but does not enhance vocal learning in zebra finches
title_full_unstemmed Adding colour-realistic video images to audio playbacks increases stimulus engagement but does not enhance vocal learning in zebra finches
title_short Adding colour-realistic video images to audio playbacks increases stimulus engagement but does not enhance vocal learning in zebra finches
title_sort adding colour-realistic video images to audio playbacks increases stimulus engagement but does not enhance vocal learning in zebra finches
topic Original Paper
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8940817/
https://www.ncbi.nlm.nih.gov/pubmed/34405288
http://dx.doi.org/10.1007/s10071-021-01547-8
work_keys_str_mv AT varkevisserjudithm addingcolourrealisticvideoimagestoaudioplaybacksincreasesstimulusengagementbutdoesnotenhancevocallearninginzebrafinches
AT simonralph addingcolourrealisticvideoimagestoaudioplaybacksincreasesstimulusengagementbutdoesnotenhancevocallearninginzebrafinches
AT mendozaezequiel addingcolourrealisticvideoimagestoaudioplaybacksincreasesstimulusengagementbutdoesnotenhancevocallearninginzebrafinches
AT howmartin addingcolourrealisticvideoimagestoaudioplaybacksincreasesstimulusengagementbutdoesnotenhancevocallearninginzebrafinches
AT vanhijlkemaidse addingcolourrealisticvideoimagestoaudioplaybacksincreasesstimulusengagementbutdoesnotenhancevocallearninginzebrafinches
AT jinrozanda addingcolourrealisticvideoimagestoaudioplaybacksincreasesstimulusengagementbutdoesnotenhancevocallearninginzebrafinches
AT liangqiaoyi addingcolourrealisticvideoimagestoaudioplaybacksincreasesstimulusengagementbutdoesnotenhancevocallearninginzebrafinches
AT scharffconstance addingcolourrealisticvideoimagestoaudioplaybacksincreasesstimulusengagementbutdoesnotenhancevocallearninginzebrafinches
AT halfwerkwouterh addingcolourrealisticvideoimagestoaudioplaybacksincreasesstimulusengagementbutdoesnotenhancevocallearninginzebrafinches
AT riebelkatharina addingcolourrealisticvideoimagestoaudioplaybacksincreasesstimulusengagementbutdoesnotenhancevocallearninginzebrafinches