Cargando…
Unraveling dyadic psycho-physiology of social presence between strangers during an audio drama – a signal-analysis approach
A mere co-presence of an unfamiliar person may modulate an individual’s attentive engagement with specific events or situations to a significant degree. To understand better how such social presence affects experiences, we recorded a set of parallel multimodal facial and psychophysiological data wit...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10622809/ https://www.ncbi.nlm.nih.gov/pubmed/37928563 http://dx.doi.org/10.3389/fpsyg.2023.1153968 |
_version_ | 1785130624423559168 |
---|---|
author | Kauttonen, Janne Paekivi, Sander Kauramäki, Jaakko Tikka, Pia |
author_facet | Kauttonen, Janne Paekivi, Sander Kauramäki, Jaakko Tikka, Pia |
author_sort | Kauttonen, Janne |
collection | PubMed |
description | A mere co-presence of an unfamiliar person may modulate an individual’s attentive engagement with specific events or situations to a significant degree. To understand better how such social presence affects experiences, we recorded a set of parallel multimodal facial and psychophysiological data with subjects (N = 36) who listened to dramatic audio scenes alone or when facing an unfamiliar person. Both a selection of 6 s affective sound clips (IADS-2) followed by a 27 min soundtrack extracted from a Finnish episode film depicted familiar and often intense social situations familiar from the everyday world. Considering the systemic complexity of both the chosen naturalistic stimuli and expected variations in the experimental social situation, we applied a novel combination of signal analysis methods using inter-subject correlation (ISC) analysis, Representational Similarity Analysis (RSA) and Recurrence Quantification Analysis (RQA) followed by gradient boosting classification. We report our findings concerning three facial signals, gaze, eyebrow and smile that can be linked to socially motivated facial movements. We found that ISC values of pairs, whether calculated on true pairs or any two individuals who had a partner, were lower than the group with single individuals. Thus, audio stimuli induced more unique responses in those subjects who were listening to it in the presence of another person, while individual listeners tended to yield a more uniform response as it was driven by dramatized audio stimulus alone. Furthermore, our classifiers models trained using recurrence properties of gaze, eyebrows and smile signals demonstrated distinctive differences in the recurrence dynamics of signals from paired subjects and revealed the impact of individual differences on the latter. We showed that the presence of an unfamiliar co-listener that modifies social dynamics of dyadic listening tasks can be detected reliably from visible facial modalities. By applying our analysis framework to a broader range of psycho-physiological data, together with annotations of the content, and subjective reports of participants, we expected more detailed dyadic dependencies to be revealed. Our work contributes towards modeling and predicting human social behaviors to specific types of audio-visually mediated, virtual, and live social situations. |
format | Online Article Text |
id | pubmed-10622809 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-106228092023-11-04 Unraveling dyadic psycho-physiology of social presence between strangers during an audio drama – a signal-analysis approach Kauttonen, Janne Paekivi, Sander Kauramäki, Jaakko Tikka, Pia Front Psychol Psychology A mere co-presence of an unfamiliar person may modulate an individual’s attentive engagement with specific events or situations to a significant degree. To understand better how such social presence affects experiences, we recorded a set of parallel multimodal facial and psychophysiological data with subjects (N = 36) who listened to dramatic audio scenes alone or when facing an unfamiliar person. Both a selection of 6 s affective sound clips (IADS-2) followed by a 27 min soundtrack extracted from a Finnish episode film depicted familiar and often intense social situations familiar from the everyday world. Considering the systemic complexity of both the chosen naturalistic stimuli and expected variations in the experimental social situation, we applied a novel combination of signal analysis methods using inter-subject correlation (ISC) analysis, Representational Similarity Analysis (RSA) and Recurrence Quantification Analysis (RQA) followed by gradient boosting classification. We report our findings concerning three facial signals, gaze, eyebrow and smile that can be linked to socially motivated facial movements. We found that ISC values of pairs, whether calculated on true pairs or any two individuals who had a partner, were lower than the group with single individuals. Thus, audio stimuli induced more unique responses in those subjects who were listening to it in the presence of another person, while individual listeners tended to yield a more uniform response as it was driven by dramatized audio stimulus alone. Furthermore, our classifiers models trained using recurrence properties of gaze, eyebrows and smile signals demonstrated distinctive differences in the recurrence dynamics of signals from paired subjects and revealed the impact of individual differences on the latter. We showed that the presence of an unfamiliar co-listener that modifies social dynamics of dyadic listening tasks can be detected reliably from visible facial modalities. By applying our analysis framework to a broader range of psycho-physiological data, together with annotations of the content, and subjective reports of participants, we expected more detailed dyadic dependencies to be revealed. Our work contributes towards modeling and predicting human social behaviors to specific types of audio-visually mediated, virtual, and live social situations. Frontiers Media S.A. 2023-10-19 /pmc/articles/PMC10622809/ /pubmed/37928563 http://dx.doi.org/10.3389/fpsyg.2023.1153968 Text en Copyright © 2023 Kauttonen, Paekivi, Kauramäki and Tikka. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Psychology Kauttonen, Janne Paekivi, Sander Kauramäki, Jaakko Tikka, Pia Unraveling dyadic psycho-physiology of social presence between strangers during an audio drama – a signal-analysis approach |
title | Unraveling dyadic psycho-physiology of social presence between strangers during an audio drama – a signal-analysis approach |
title_full | Unraveling dyadic psycho-physiology of social presence between strangers during an audio drama – a signal-analysis approach |
title_fullStr | Unraveling dyadic psycho-physiology of social presence between strangers during an audio drama – a signal-analysis approach |
title_full_unstemmed | Unraveling dyadic psycho-physiology of social presence between strangers during an audio drama – a signal-analysis approach |
title_short | Unraveling dyadic psycho-physiology of social presence between strangers during an audio drama – a signal-analysis approach |
title_sort | unraveling dyadic psycho-physiology of social presence between strangers during an audio drama – a signal-analysis approach |
topic | Psychology |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10622809/ https://www.ncbi.nlm.nih.gov/pubmed/37928563 http://dx.doi.org/10.3389/fpsyg.2023.1153968 |
work_keys_str_mv | AT kauttonenjanne unravelingdyadicpsychophysiologyofsocialpresencebetweenstrangersduringanaudiodramaasignalanalysisapproach AT paekivisander unravelingdyadicpsychophysiologyofsocialpresencebetweenstrangersduringanaudiodramaasignalanalysisapproach AT kauramakijaakko unravelingdyadicpsychophysiologyofsocialpresencebetweenstrangersduringanaudiodramaasignalanalysisapproach AT tikkapia unravelingdyadicpsychophysiologyofsocialpresencebetweenstrangersduringanaudiodramaasignalanalysisapproach |