Cargando…

Climate data sonification and visualization: An analysis of topics, aesthetics, and characteristics in 32 recent projects

INTRODUCTION: It has proven a hard challenge to stimulate climate action with climate data. While scientists communicate through words, numbers, and diagrams, artists use movement, images, and sound. Sonification, the translation of data into sound, and visualization, offer techniques for representi...

Descripción completa

Detalles Bibliográficos
Autores principales: Lindborg, PerMagnus, Lenzi, Sara, Chen, Manni
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9905236/
https://www.ncbi.nlm.nih.gov/pubmed/36760901
http://dx.doi.org/10.3389/fpsyg.2022.1020102
_version_ 1784883787529715712
author Lindborg, PerMagnus
Lenzi, Sara
Chen, Manni
author_facet Lindborg, PerMagnus
Lenzi, Sara
Chen, Manni
author_sort Lindborg, PerMagnus
collection PubMed
description INTRODUCTION: It has proven a hard challenge to stimulate climate action with climate data. While scientists communicate through words, numbers, and diagrams, artists use movement, images, and sound. Sonification, the translation of data into sound, and visualization, offer techniques for representing climate data with often innovative and exciting results. The concept of sonification was initially defined in terms of engineering, and while this view remains dominant, researchers increasingly make use of knowledge from electroacoustic music (EAM) to make sonifications more convincing. METHODS: The Aesthetic Perspective Space (APS) is a two-dimensional model that bridges utilitarian-oriented sonification and music. We started with a review of 395 sonification projects, from which a corpus of 32 that target climate change was chosen; a subset of 18 also integrate visualization of the data. To clarify relationships with climate data sources, we determined topics and subtopics in a hierarchical classification. Media duration and lexical diversity in descriptions were determined. We developed a protocol to span the APS dimensions, Intentionality and Indexicality, and evaluated its circumplexity. RESULTS: We constructed 25 scales to cover a range of qualitative characteristics applicable to sonification and sonification-visualization projects, and through exploratory factor analysis, identified five essential aspects of the project descriptions, labeled Action, Technical, Context, Perspective, and Visualization. Through linear regression modeling, we investigated the prediction of aesthetic perspective from essential aspects, media duration, and lexical diversity. Significant regressions across the corpus were identified for Perspective (ß = 0.41(***)) and lexical diversity (ß = −0.23(*)) on Intentionality, and for Perspective (ß = 0.36(***)) and Duration (logarithmic; ß = −0.25(*)) on Indexicality. DISCUSSION: We discuss how these relationships play out in specific projects, also within the corpus subset that integrated data visualization, as well as broader implications of aesthetics on design techniques for multimodal representations aimed at conveying scientific data. Our approach is informed by the ongoing discussion in sound design and auditory perception research communities on the relationship between sonification and EAM. Through its analysis of topics, qualitative characteristics, and aesthetics across a range of projects, our study contributes to the development of empirically founded design techniques, applicable to climate science communication and other fields.
format Online
Article
Text
id pubmed-9905236
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-99052362023-02-08 Climate data sonification and visualization: An analysis of topics, aesthetics, and characteristics in 32 recent projects Lindborg, PerMagnus Lenzi, Sara Chen, Manni Front Psychol Psychology INTRODUCTION: It has proven a hard challenge to stimulate climate action with climate data. While scientists communicate through words, numbers, and diagrams, artists use movement, images, and sound. Sonification, the translation of data into sound, and visualization, offer techniques for representing climate data with often innovative and exciting results. The concept of sonification was initially defined in terms of engineering, and while this view remains dominant, researchers increasingly make use of knowledge from electroacoustic music (EAM) to make sonifications more convincing. METHODS: The Aesthetic Perspective Space (APS) is a two-dimensional model that bridges utilitarian-oriented sonification and music. We started with a review of 395 sonification projects, from which a corpus of 32 that target climate change was chosen; a subset of 18 also integrate visualization of the data. To clarify relationships with climate data sources, we determined topics and subtopics in a hierarchical classification. Media duration and lexical diversity in descriptions were determined. We developed a protocol to span the APS dimensions, Intentionality and Indexicality, and evaluated its circumplexity. RESULTS: We constructed 25 scales to cover a range of qualitative characteristics applicable to sonification and sonification-visualization projects, and through exploratory factor analysis, identified five essential aspects of the project descriptions, labeled Action, Technical, Context, Perspective, and Visualization. Through linear regression modeling, we investigated the prediction of aesthetic perspective from essential aspects, media duration, and lexical diversity. Significant regressions across the corpus were identified for Perspective (ß = 0.41(***)) and lexical diversity (ß = −0.23(*)) on Intentionality, and for Perspective (ß = 0.36(***)) and Duration (logarithmic; ß = −0.25(*)) on Indexicality. DISCUSSION: We discuss how these relationships play out in specific projects, also within the corpus subset that integrated data visualization, as well as broader implications of aesthetics on design techniques for multimodal representations aimed at conveying scientific data. Our approach is informed by the ongoing discussion in sound design and auditory perception research communities on the relationship between sonification and EAM. Through its analysis of topics, qualitative characteristics, and aesthetics across a range of projects, our study contributes to the development of empirically founded design techniques, applicable to climate science communication and other fields. Frontiers Media S.A. 2023-01-25 /pmc/articles/PMC9905236/ /pubmed/36760901 http://dx.doi.org/10.3389/fpsyg.2022.1020102 Text en Copyright © 2023 Lindborg, Lenzi and Chen. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Psychology
Lindborg, PerMagnus
Lenzi, Sara
Chen, Manni
Climate data sonification and visualization: An analysis of topics, aesthetics, and characteristics in 32 recent projects
title Climate data sonification and visualization: An analysis of topics, aesthetics, and characteristics in 32 recent projects
title_full Climate data sonification and visualization: An analysis of topics, aesthetics, and characteristics in 32 recent projects
title_fullStr Climate data sonification and visualization: An analysis of topics, aesthetics, and characteristics in 32 recent projects
title_full_unstemmed Climate data sonification and visualization: An analysis of topics, aesthetics, and characteristics in 32 recent projects
title_short Climate data sonification and visualization: An analysis of topics, aesthetics, and characteristics in 32 recent projects
title_sort climate data sonification and visualization: an analysis of topics, aesthetics, and characteristics in 32 recent projects
topic Psychology
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9905236/
https://www.ncbi.nlm.nih.gov/pubmed/36760901
http://dx.doi.org/10.3389/fpsyg.2022.1020102
work_keys_str_mv AT lindborgpermagnus climatedatasonificationandvisualizationananalysisoftopicsaestheticsandcharacteristicsin32recentprojects
AT lenzisara climatedatasonificationandvisualizationananalysisoftopicsaestheticsandcharacteristicsin32recentprojects
AT chenmanni climatedatasonificationandvisualizationananalysisoftopicsaestheticsandcharacteristicsin32recentprojects