Cargando…

The recognition of facial expressions of emotion in deaf and hearing individuals

During real-life interactions, facial expressions of emotion are perceived dynamically with multimodal sensory information. In the absence of auditory sensory channel inputs, it is unclear how facial expressions are recognised and internally represented by deaf individuals. Few studies have investig...

Descripción completa

Detalles Bibliográficos
Autores principales: Rodger, Helen, Lao, Junpeng, Stoll, Chloé, Richoz, Anne-Raphaëlle, Pascalis, Olivier, Dye, Matthew, Caldara, Roberto
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Elsevier 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8141778/
https://www.ncbi.nlm.nih.gov/pubmed/34041389
http://dx.doi.org/10.1016/j.heliyon.2021.e07018
_version_ 1783696437288108032
author Rodger, Helen
Lao, Junpeng
Stoll, Chloé
Richoz, Anne-Raphaëlle
Pascalis, Olivier
Dye, Matthew
Caldara, Roberto
author_facet Rodger, Helen
Lao, Junpeng
Stoll, Chloé
Richoz, Anne-Raphaëlle
Pascalis, Olivier
Dye, Matthew
Caldara, Roberto
author_sort Rodger, Helen
collection PubMed
description During real-life interactions, facial expressions of emotion are perceived dynamically with multimodal sensory information. In the absence of auditory sensory channel inputs, it is unclear how facial expressions are recognised and internally represented by deaf individuals. Few studies have investigated facial expression recognition in deaf signers using dynamic stimuli, and none have included all six basic facial expressions of emotion (anger, disgust, fear, happiness, sadness, and surprise) with stimuli fully controlled for their low-level visual properties, leaving the question of whether or not a dynamic advantage for deaf observers exists unresolved. We hypothesised, in line with the enhancement hypothesis, that the absence of auditory sensory information might have forced the visual system to better process visual (unimodal) signals, and predicted that this greater sensitivity to visual stimuli would result in better recognition performance for dynamic compared to static stimuli, and for deaf-signers compared to hearing non-signers in the dynamic condition. To this end, we performed a series of psychophysical studies with deaf signers with early-onset severe-to-profound deafness (dB loss >70) and hearing controls to estimate their ability to recognize the six basic facial expressions of emotion. Using static, dynamic, and shuffled (randomly permuted video frames of an expression) stimuli, we found that deaf observers showed similar categorization profiles and confusions across expressions compared to hearing controls (e.g., confusing surprise with fear). In contrast to our hypothesis, we found no recognition advantage for dynamic compared to static facial expressions for deaf observers. This observation shows that the decoding of dynamic facial expression emotional signals is not superior even in the deaf expert visual system, suggesting the existence of optimal signals in static facial expressions of emotion at the apex. Deaf individuals match hearing individuals in the recognition of facial expressions of emotion.
format Online
Article
Text
id pubmed-8141778
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Elsevier
record_format MEDLINE/PubMed
spelling pubmed-81417782021-05-25 The recognition of facial expressions of emotion in deaf and hearing individuals Rodger, Helen Lao, Junpeng Stoll, Chloé Richoz, Anne-Raphaëlle Pascalis, Olivier Dye, Matthew Caldara, Roberto Heliyon Research Article During real-life interactions, facial expressions of emotion are perceived dynamically with multimodal sensory information. In the absence of auditory sensory channel inputs, it is unclear how facial expressions are recognised and internally represented by deaf individuals. Few studies have investigated facial expression recognition in deaf signers using dynamic stimuli, and none have included all six basic facial expressions of emotion (anger, disgust, fear, happiness, sadness, and surprise) with stimuli fully controlled for their low-level visual properties, leaving the question of whether or not a dynamic advantage for deaf observers exists unresolved. We hypothesised, in line with the enhancement hypothesis, that the absence of auditory sensory information might have forced the visual system to better process visual (unimodal) signals, and predicted that this greater sensitivity to visual stimuli would result in better recognition performance for dynamic compared to static stimuli, and for deaf-signers compared to hearing non-signers in the dynamic condition. To this end, we performed a series of psychophysical studies with deaf signers with early-onset severe-to-profound deafness (dB loss >70) and hearing controls to estimate their ability to recognize the six basic facial expressions of emotion. Using static, dynamic, and shuffled (randomly permuted video frames of an expression) stimuli, we found that deaf observers showed similar categorization profiles and confusions across expressions compared to hearing controls (e.g., confusing surprise with fear). In contrast to our hypothesis, we found no recognition advantage for dynamic compared to static facial expressions for deaf observers. This observation shows that the decoding of dynamic facial expression emotional signals is not superior even in the deaf expert visual system, suggesting the existence of optimal signals in static facial expressions of emotion at the apex. Deaf individuals match hearing individuals in the recognition of facial expressions of emotion. Elsevier 2021-05-15 /pmc/articles/PMC8141778/ /pubmed/34041389 http://dx.doi.org/10.1016/j.heliyon.2021.e07018 Text en © 2021 The Author(s) https://creativecommons.org/licenses/by-nc-nd/4.0/This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
spellingShingle Research Article
Rodger, Helen
Lao, Junpeng
Stoll, Chloé
Richoz, Anne-Raphaëlle
Pascalis, Olivier
Dye, Matthew
Caldara, Roberto
The recognition of facial expressions of emotion in deaf and hearing individuals
title The recognition of facial expressions of emotion in deaf and hearing individuals
title_full The recognition of facial expressions of emotion in deaf and hearing individuals
title_fullStr The recognition of facial expressions of emotion in deaf and hearing individuals
title_full_unstemmed The recognition of facial expressions of emotion in deaf and hearing individuals
title_short The recognition of facial expressions of emotion in deaf and hearing individuals
title_sort recognition of facial expressions of emotion in deaf and hearing individuals
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8141778/
https://www.ncbi.nlm.nih.gov/pubmed/34041389
http://dx.doi.org/10.1016/j.heliyon.2021.e07018
work_keys_str_mv AT rodgerhelen therecognitionoffacialexpressionsofemotionindeafandhearingindividuals
AT laojunpeng therecognitionoffacialexpressionsofemotionindeafandhearingindividuals
AT stollchloe therecognitionoffacialexpressionsofemotionindeafandhearingindividuals
AT richozanneraphaelle therecognitionoffacialexpressionsofemotionindeafandhearingindividuals
AT pascalisolivier therecognitionoffacialexpressionsofemotionindeafandhearingindividuals
AT dyematthew therecognitionoffacialexpressionsofemotionindeafandhearingindividuals
AT caldararoberto therecognitionoffacialexpressionsofemotionindeafandhearingindividuals
AT rodgerhelen recognitionoffacialexpressionsofemotionindeafandhearingindividuals
AT laojunpeng recognitionoffacialexpressionsofemotionindeafandhearingindividuals
AT stollchloe recognitionoffacialexpressionsofemotionindeafandhearingindividuals
AT richozanneraphaelle recognitionoffacialexpressionsofemotionindeafandhearingindividuals
AT pascalisolivier recognitionoffacialexpressionsofemotionindeafandhearingindividuals
AT dyematthew recognitionoffacialexpressionsofemotionindeafandhearingindividuals
AT caldararoberto recognitionoffacialexpressionsofemotionindeafandhearingindividuals