Cargando…

Deepfake smiles matter less—the psychological and neural impact of presumed AI-generated faces

High-quality AI-generated portraits (“deepfakes”) are becoming increasingly prevalent. Understanding the responses they evoke in perceivers is crucial in assessing their societal implications. Here we investigate the impact of the belief that depicted persons are real or deepfakes on psychological a...

Descripción completa

Detalles Bibliográficos
Autores principales: Eiserbeck, Anna, Maier, Martin, Baum, Julia, Abdel Rahman, Rasha
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10522659/
https://www.ncbi.nlm.nih.gov/pubmed/37752242
http://dx.doi.org/10.1038/s41598-023-42802-x
_version_ 1785110399298830336
author Eiserbeck, Anna
Maier, Martin
Baum, Julia
Abdel Rahman, Rasha
author_facet Eiserbeck, Anna
Maier, Martin
Baum, Julia
Abdel Rahman, Rasha
author_sort Eiserbeck, Anna
collection PubMed
description High-quality AI-generated portraits (“deepfakes”) are becoming increasingly prevalent. Understanding the responses they evoke in perceivers is crucial in assessing their societal implications. Here we investigate the impact of the belief that depicted persons are real or deepfakes on psychological and neural measures of human face perception. Using EEG, we tracked participants’ (N = 30) brain responses to real faces showing positive, neutral, and negative expressions, after being informed that they are either real or fake. Smiling faces marked as fake appeared less positive, as reflected in expression ratings, and induced slower evaluations. Whereas presumed real smiles elicited canonical emotion effects with differences relative to neutral faces in the P1 and N170 components (markers of early visual perception) and in the EPN component (indicative of reflexive emotional processing), presumed deepfake smiles showed none of these effects. Additionally, only smiles presumed as fake showed enhanced LPP activity compared to neutral faces, suggesting more effortful evaluation. Negative expressions induced typical emotion effects, whether considered real or fake. Our findings demonstrate a dampening effect on perceptual, emotional, and evaluative processing of presumed deepfake smiles, but not angry expressions, adding new specificity to the debate on the societal impact of AI-generated content.
format Online
Article
Text
id pubmed-10522659
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-105226592023-09-28 Deepfake smiles matter less—the psychological and neural impact of presumed AI-generated faces Eiserbeck, Anna Maier, Martin Baum, Julia Abdel Rahman, Rasha Sci Rep Article High-quality AI-generated portraits (“deepfakes”) are becoming increasingly prevalent. Understanding the responses they evoke in perceivers is crucial in assessing their societal implications. Here we investigate the impact of the belief that depicted persons are real or deepfakes on psychological and neural measures of human face perception. Using EEG, we tracked participants’ (N = 30) brain responses to real faces showing positive, neutral, and negative expressions, after being informed that they are either real or fake. Smiling faces marked as fake appeared less positive, as reflected in expression ratings, and induced slower evaluations. Whereas presumed real smiles elicited canonical emotion effects with differences relative to neutral faces in the P1 and N170 components (markers of early visual perception) and in the EPN component (indicative of reflexive emotional processing), presumed deepfake smiles showed none of these effects. Additionally, only smiles presumed as fake showed enhanced LPP activity compared to neutral faces, suggesting more effortful evaluation. Negative expressions induced typical emotion effects, whether considered real or fake. Our findings demonstrate a dampening effect on perceptual, emotional, and evaluative processing of presumed deepfake smiles, but not angry expressions, adding new specificity to the debate on the societal impact of AI-generated content. Nature Publishing Group UK 2023-09-26 /pmc/articles/PMC10522659/ /pubmed/37752242 http://dx.doi.org/10.1038/s41598-023-42802-x Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Eiserbeck, Anna
Maier, Martin
Baum, Julia
Abdel Rahman, Rasha
Deepfake smiles matter less—the psychological and neural impact of presumed AI-generated faces
title Deepfake smiles matter less—the psychological and neural impact of presumed AI-generated faces
title_full Deepfake smiles matter less—the psychological and neural impact of presumed AI-generated faces
title_fullStr Deepfake smiles matter less—the psychological and neural impact of presumed AI-generated faces
title_full_unstemmed Deepfake smiles matter less—the psychological and neural impact of presumed AI-generated faces
title_short Deepfake smiles matter less—the psychological and neural impact of presumed AI-generated faces
title_sort deepfake smiles matter less—the psychological and neural impact of presumed ai-generated faces
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10522659/
https://www.ncbi.nlm.nih.gov/pubmed/37752242
http://dx.doi.org/10.1038/s41598-023-42802-x
work_keys_str_mv AT eiserbeckanna deepfakesmilesmatterlessthepsychologicalandneuralimpactofpresumedaigeneratedfaces
AT maiermartin deepfakesmilesmatterlessthepsychologicalandneuralimpactofpresumedaigeneratedfaces
AT baumjulia deepfakesmilesmatterlessthepsychologicalandneuralimpactofpresumedaigeneratedfaces
AT abdelrahmanrasha deepfakesmilesmatterlessthepsychologicalandneuralimpactofpresumedaigeneratedfaces