Cargando…
A Perceiver-Centered Approach for Representing and Annotating Prosodic Functions in Performed Music
Musical prosody is characterized by the acoustic variations that make music expressive. However, few systematic and scalable studies exist on the function it serves or on effective tools to carry out such studies. To address this gap, we introduce a novel approach to capturing information about pros...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9355529/ https://www.ncbi.nlm.nih.gov/pubmed/35936330 http://dx.doi.org/10.3389/fpsyg.2022.886570 |
_version_ | 1784763314820087808 |
---|---|
author | Bedoya, Daniel Fyfe, Lawrence Chew, Elaine |
author_facet | Bedoya, Daniel Fyfe, Lawrence Chew, Elaine |
author_sort | Bedoya, Daniel |
collection | PubMed |
description | Musical prosody is characterized by the acoustic variations that make music expressive. However, few systematic and scalable studies exist on the function it serves or on effective tools to carry out such studies. To address this gap, we introduce a novel approach to capturing information about prosodic functions through a citizen science paradigm. In typical bottom-up approaches to studying musical prosody, acoustic properties in performed music and basic musical structures such as accents and phrases are mapped to prosodic functions, namely segmentation and prominence. In contrast, our top-down, human-centered method puts listener annotations of musical prosodic functions first, to analyze the connection between these functions, the underlying musical structures, and acoustic properties. The method is applied primarily to the exploring of segmentation and prominence in performed solo piano music. These prosodic functions are marked by means of four annotation types—boundaries, regions, note groups, and comments—in the CosmoNote web-based citizen science platform, which presents the music signal or MIDI data and related acoustic features in information layers that can be toggled on and off. Various annotation strategies are discussed and appraised: intuitive vs. analytical; real-time vs. retrospective; and, audio-based vs. visual. The end-to-end process of the data collection is described, from the providing of prosodic examples to the structuring and formatting of the annotation data for analysis, to techniques for preventing precision errors. The aim is to obtain reliable and coherent annotations that can be applied to theoretical and data-driven models of musical prosody. The outcomes include a growing library of prosodic examples with the goal of achieving an annotation convention for studying musical prosody in performed music. |
format | Online Article Text |
id | pubmed-9355529 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-93555292022-08-06 A Perceiver-Centered Approach for Representing and Annotating Prosodic Functions in Performed Music Bedoya, Daniel Fyfe, Lawrence Chew, Elaine Front Psychol Psychology Musical prosody is characterized by the acoustic variations that make music expressive. However, few systematic and scalable studies exist on the function it serves or on effective tools to carry out such studies. To address this gap, we introduce a novel approach to capturing information about prosodic functions through a citizen science paradigm. In typical bottom-up approaches to studying musical prosody, acoustic properties in performed music and basic musical structures such as accents and phrases are mapped to prosodic functions, namely segmentation and prominence. In contrast, our top-down, human-centered method puts listener annotations of musical prosodic functions first, to analyze the connection between these functions, the underlying musical structures, and acoustic properties. The method is applied primarily to the exploring of segmentation and prominence in performed solo piano music. These prosodic functions are marked by means of four annotation types—boundaries, regions, note groups, and comments—in the CosmoNote web-based citizen science platform, which presents the music signal or MIDI data and related acoustic features in information layers that can be toggled on and off. Various annotation strategies are discussed and appraised: intuitive vs. analytical; real-time vs. retrospective; and, audio-based vs. visual. The end-to-end process of the data collection is described, from the providing of prosodic examples to the structuring and formatting of the annotation data for analysis, to techniques for preventing precision errors. The aim is to obtain reliable and coherent annotations that can be applied to theoretical and data-driven models of musical prosody. The outcomes include a growing library of prosodic examples with the goal of achieving an annotation convention for studying musical prosody in performed music. Frontiers Media S.A. 2022-07-21 /pmc/articles/PMC9355529/ /pubmed/35936330 http://dx.doi.org/10.3389/fpsyg.2022.886570 Text en Copyright © 2022 Bedoya, Fyfe and Chew. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Psychology Bedoya, Daniel Fyfe, Lawrence Chew, Elaine A Perceiver-Centered Approach for Representing and Annotating Prosodic Functions in Performed Music |
title | A Perceiver-Centered Approach for Representing and Annotating Prosodic Functions in Performed Music |
title_full | A Perceiver-Centered Approach for Representing and Annotating Prosodic Functions in Performed Music |
title_fullStr | A Perceiver-Centered Approach for Representing and Annotating Prosodic Functions in Performed Music |
title_full_unstemmed | A Perceiver-Centered Approach for Representing and Annotating Prosodic Functions in Performed Music |
title_short | A Perceiver-Centered Approach for Representing and Annotating Prosodic Functions in Performed Music |
title_sort | perceiver-centered approach for representing and annotating prosodic functions in performed music |
topic | Psychology |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9355529/ https://www.ncbi.nlm.nih.gov/pubmed/35936330 http://dx.doi.org/10.3389/fpsyg.2022.886570 |
work_keys_str_mv | AT bedoyadaniel aperceivercenteredapproachforrepresentingandannotatingprosodicfunctionsinperformedmusic AT fyfelawrence aperceivercenteredapproachforrepresentingandannotatingprosodicfunctionsinperformedmusic AT chewelaine aperceivercenteredapproachforrepresentingandannotatingprosodicfunctionsinperformedmusic AT bedoyadaniel perceivercenteredapproachforrepresentingandannotatingprosodicfunctionsinperformedmusic AT fyfelawrence perceivercenteredapproachforrepresentingandannotatingprosodicfunctionsinperformedmusic AT chewelaine perceivercenteredapproachforrepresentingandannotatingprosodicfunctionsinperformedmusic |