Cargando…

A Perceiver-Centered Approach for Representing and Annotating Prosodic Functions in Performed Music

Musical prosody is characterized by the acoustic variations that make music expressive. However, few systematic and scalable studies exist on the function it serves or on effective tools to carry out such studies. To address this gap, we introduce a novel approach to capturing information about pros...

Descripción completa

Detalles Bibliográficos
Autores principales: Bedoya, Daniel, Fyfe, Lawrence, Chew, Elaine
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9355529/
https://www.ncbi.nlm.nih.gov/pubmed/35936330
http://dx.doi.org/10.3389/fpsyg.2022.886570
_version_ 1784763314820087808
author Bedoya, Daniel
Fyfe, Lawrence
Chew, Elaine
author_facet Bedoya, Daniel
Fyfe, Lawrence
Chew, Elaine
author_sort Bedoya, Daniel
collection PubMed
description Musical prosody is characterized by the acoustic variations that make music expressive. However, few systematic and scalable studies exist on the function it serves or on effective tools to carry out such studies. To address this gap, we introduce a novel approach to capturing information about prosodic functions through a citizen science paradigm. In typical bottom-up approaches to studying musical prosody, acoustic properties in performed music and basic musical structures such as accents and phrases are mapped to prosodic functions, namely segmentation and prominence. In contrast, our top-down, human-centered method puts listener annotations of musical prosodic functions first, to analyze the connection between these functions, the underlying musical structures, and acoustic properties. The method is applied primarily to the exploring of segmentation and prominence in performed solo piano music. These prosodic functions are marked by means of four annotation types—boundaries, regions, note groups, and comments—in the CosmoNote web-based citizen science platform, which presents the music signal or MIDI data and related acoustic features in information layers that can be toggled on and off. Various annotation strategies are discussed and appraised: intuitive vs. analytical; real-time vs. retrospective; and, audio-based vs. visual. The end-to-end process of the data collection is described, from the providing of prosodic examples to the structuring and formatting of the annotation data for analysis, to techniques for preventing precision errors. The aim is to obtain reliable and coherent annotations that can be applied to theoretical and data-driven models of musical prosody. The outcomes include a growing library of prosodic examples with the goal of achieving an annotation convention for studying musical prosody in performed music.
format Online
Article
Text
id pubmed-9355529
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-93555292022-08-06 A Perceiver-Centered Approach for Representing and Annotating Prosodic Functions in Performed Music Bedoya, Daniel Fyfe, Lawrence Chew, Elaine Front Psychol Psychology Musical prosody is characterized by the acoustic variations that make music expressive. However, few systematic and scalable studies exist on the function it serves or on effective tools to carry out such studies. To address this gap, we introduce a novel approach to capturing information about prosodic functions through a citizen science paradigm. In typical bottom-up approaches to studying musical prosody, acoustic properties in performed music and basic musical structures such as accents and phrases are mapped to prosodic functions, namely segmentation and prominence. In contrast, our top-down, human-centered method puts listener annotations of musical prosodic functions first, to analyze the connection between these functions, the underlying musical structures, and acoustic properties. The method is applied primarily to the exploring of segmentation and prominence in performed solo piano music. These prosodic functions are marked by means of four annotation types—boundaries, regions, note groups, and comments—in the CosmoNote web-based citizen science platform, which presents the music signal or MIDI data and related acoustic features in information layers that can be toggled on and off. Various annotation strategies are discussed and appraised: intuitive vs. analytical; real-time vs. retrospective; and, audio-based vs. visual. The end-to-end process of the data collection is described, from the providing of prosodic examples to the structuring and formatting of the annotation data for analysis, to techniques for preventing precision errors. The aim is to obtain reliable and coherent annotations that can be applied to theoretical and data-driven models of musical prosody. The outcomes include a growing library of prosodic examples with the goal of achieving an annotation convention for studying musical prosody in performed music. Frontiers Media S.A. 2022-07-21 /pmc/articles/PMC9355529/ /pubmed/35936330 http://dx.doi.org/10.3389/fpsyg.2022.886570 Text en Copyright © 2022 Bedoya, Fyfe and Chew. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Psychology
Bedoya, Daniel
Fyfe, Lawrence
Chew, Elaine
A Perceiver-Centered Approach for Representing and Annotating Prosodic Functions in Performed Music
title A Perceiver-Centered Approach for Representing and Annotating Prosodic Functions in Performed Music
title_full A Perceiver-Centered Approach for Representing and Annotating Prosodic Functions in Performed Music
title_fullStr A Perceiver-Centered Approach for Representing and Annotating Prosodic Functions in Performed Music
title_full_unstemmed A Perceiver-Centered Approach for Representing and Annotating Prosodic Functions in Performed Music
title_short A Perceiver-Centered Approach for Representing and Annotating Prosodic Functions in Performed Music
title_sort perceiver-centered approach for representing and annotating prosodic functions in performed music
topic Psychology
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9355529/
https://www.ncbi.nlm.nih.gov/pubmed/35936330
http://dx.doi.org/10.3389/fpsyg.2022.886570
work_keys_str_mv AT bedoyadaniel aperceivercenteredapproachforrepresentingandannotatingprosodicfunctionsinperformedmusic
AT fyfelawrence aperceivercenteredapproachforrepresentingandannotatingprosodicfunctionsinperformedmusic
AT chewelaine aperceivercenteredapproachforrepresentingandannotatingprosodicfunctionsinperformedmusic
AT bedoyadaniel perceivercenteredapproachforrepresentingandannotatingprosodicfunctionsinperformedmusic
AT fyfelawrence perceivercenteredapproachforrepresentingandannotatingprosodicfunctionsinperformedmusic
AT chewelaine perceivercenteredapproachforrepresentingandannotatingprosodicfunctionsinperformedmusic