Cargando…

Unraveling dyadic psycho-physiology of social presence between strangers during an audio drama – a signal-analysis approach

A mere co-presence of an unfamiliar person may modulate an individual’s attentive engagement with specific events or situations to a significant degree. To understand better how such social presence affects experiences, we recorded a set of parallel multimodal facial and psychophysiological data wit...

Descripción completa

Detalles Bibliográficos
Autores principales: Kauttonen, Janne, Paekivi, Sander, Kauramäki, Jaakko, Tikka, Pia
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10622809/
https://www.ncbi.nlm.nih.gov/pubmed/37928563
http://dx.doi.org/10.3389/fpsyg.2023.1153968
_version_ 1785130624423559168
author Kauttonen, Janne
Paekivi, Sander
Kauramäki, Jaakko
Tikka, Pia
author_facet Kauttonen, Janne
Paekivi, Sander
Kauramäki, Jaakko
Tikka, Pia
author_sort Kauttonen, Janne
collection PubMed
description A mere co-presence of an unfamiliar person may modulate an individual’s attentive engagement with specific events or situations to a significant degree. To understand better how such social presence affects experiences, we recorded a set of parallel multimodal facial and psychophysiological data with subjects (N = 36) who listened to dramatic audio scenes alone or when facing an unfamiliar person. Both a selection of 6 s affective sound clips (IADS-2) followed by a 27 min soundtrack extracted from a Finnish episode film depicted familiar and often intense social situations familiar from the everyday world. Considering the systemic complexity of both the chosen naturalistic stimuli and expected variations in the experimental social situation, we applied a novel combination of signal analysis methods using inter-subject correlation (ISC) analysis, Representational Similarity Analysis (RSA) and Recurrence Quantification Analysis (RQA) followed by gradient boosting classification. We report our findings concerning three facial signals, gaze, eyebrow and smile that can be linked to socially motivated facial movements. We found that ISC values of pairs, whether calculated on true pairs or any two individuals who had a partner, were lower than the group with single individuals. Thus, audio stimuli induced more unique responses in those subjects who were listening to it in the presence of another person, while individual listeners tended to yield a more uniform response as it was driven by dramatized audio stimulus alone. Furthermore, our classifiers models trained using recurrence properties of gaze, eyebrows and smile signals demonstrated distinctive differences in the recurrence dynamics of signals from paired subjects and revealed the impact of individual differences on the latter. We showed that the presence of an unfamiliar co-listener that modifies social dynamics of dyadic listening tasks can be detected reliably from visible facial modalities. By applying our analysis framework to a broader range of psycho-physiological data, together with annotations of the content, and subjective reports of participants, we expected more detailed dyadic dependencies to be revealed. Our work contributes towards modeling and predicting human social behaviors to specific types of audio-visually mediated, virtual, and live social situations.
format Online
Article
Text
id pubmed-10622809
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-106228092023-11-04 Unraveling dyadic psycho-physiology of social presence between strangers during an audio drama – a signal-analysis approach Kauttonen, Janne Paekivi, Sander Kauramäki, Jaakko Tikka, Pia Front Psychol Psychology A mere co-presence of an unfamiliar person may modulate an individual’s attentive engagement with specific events or situations to a significant degree. To understand better how such social presence affects experiences, we recorded a set of parallel multimodal facial and psychophysiological data with subjects (N = 36) who listened to dramatic audio scenes alone or when facing an unfamiliar person. Both a selection of 6 s affective sound clips (IADS-2) followed by a 27 min soundtrack extracted from a Finnish episode film depicted familiar and often intense social situations familiar from the everyday world. Considering the systemic complexity of both the chosen naturalistic stimuli and expected variations in the experimental social situation, we applied a novel combination of signal analysis methods using inter-subject correlation (ISC) analysis, Representational Similarity Analysis (RSA) and Recurrence Quantification Analysis (RQA) followed by gradient boosting classification. We report our findings concerning three facial signals, gaze, eyebrow and smile that can be linked to socially motivated facial movements. We found that ISC values of pairs, whether calculated on true pairs or any two individuals who had a partner, were lower than the group with single individuals. Thus, audio stimuli induced more unique responses in those subjects who were listening to it in the presence of another person, while individual listeners tended to yield a more uniform response as it was driven by dramatized audio stimulus alone. Furthermore, our classifiers models trained using recurrence properties of gaze, eyebrows and smile signals demonstrated distinctive differences in the recurrence dynamics of signals from paired subjects and revealed the impact of individual differences on the latter. We showed that the presence of an unfamiliar co-listener that modifies social dynamics of dyadic listening tasks can be detected reliably from visible facial modalities. By applying our analysis framework to a broader range of psycho-physiological data, together with annotations of the content, and subjective reports of participants, we expected more detailed dyadic dependencies to be revealed. Our work contributes towards modeling and predicting human social behaviors to specific types of audio-visually mediated, virtual, and live social situations. Frontiers Media S.A. 2023-10-19 /pmc/articles/PMC10622809/ /pubmed/37928563 http://dx.doi.org/10.3389/fpsyg.2023.1153968 Text en Copyright © 2023 Kauttonen, Paekivi, Kauramäki and Tikka. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Psychology
Kauttonen, Janne
Paekivi, Sander
Kauramäki, Jaakko
Tikka, Pia
Unraveling dyadic psycho-physiology of social presence between strangers during an audio drama – a signal-analysis approach
title Unraveling dyadic psycho-physiology of social presence between strangers during an audio drama – a signal-analysis approach
title_full Unraveling dyadic psycho-physiology of social presence between strangers during an audio drama – a signal-analysis approach
title_fullStr Unraveling dyadic psycho-physiology of social presence between strangers during an audio drama – a signal-analysis approach
title_full_unstemmed Unraveling dyadic psycho-physiology of social presence between strangers during an audio drama – a signal-analysis approach
title_short Unraveling dyadic psycho-physiology of social presence between strangers during an audio drama – a signal-analysis approach
title_sort unraveling dyadic psycho-physiology of social presence between strangers during an audio drama – a signal-analysis approach
topic Psychology
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10622809/
https://www.ncbi.nlm.nih.gov/pubmed/37928563
http://dx.doi.org/10.3389/fpsyg.2023.1153968
work_keys_str_mv AT kauttonenjanne unravelingdyadicpsychophysiologyofsocialpresencebetweenstrangersduringanaudiodramaasignalanalysisapproach
AT paekivisander unravelingdyadicpsychophysiologyofsocialpresencebetweenstrangersduringanaudiodramaasignalanalysisapproach
AT kauramakijaakko unravelingdyadicpsychophysiologyofsocialpresencebetweenstrangersduringanaudiodramaasignalanalysisapproach
AT tikkapia unravelingdyadicpsychophysiologyofsocialpresencebetweenstrangersduringanaudiodramaasignalanalysisapproach