Cargando…

ChatGPT outperforms humans in emotional awareness evaluations

The artificial intelligence chatbot, ChatGPT, has gained widespread attention for its ability to perform natural language processing tasks and has the fastest-growing user base in history. Although ChatGPT has successfully generated theoretical information in multiple fields, its ability to identify...

Descripción completa

Detalles Bibliográficos
Autores principales: Elyoseph, Zohar, Hadar-Shoval, Dorit, Asraf, Kfir, Lvovsky, Maya
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10254409/
https://www.ncbi.nlm.nih.gov/pubmed/37303897
http://dx.doi.org/10.3389/fpsyg.2023.1199058
_version_ 1785056635954135040
author Elyoseph, Zohar
Hadar-Shoval, Dorit
Asraf, Kfir
Lvovsky, Maya
author_facet Elyoseph, Zohar
Hadar-Shoval, Dorit
Asraf, Kfir
Lvovsky, Maya
author_sort Elyoseph, Zohar
collection PubMed
description The artificial intelligence chatbot, ChatGPT, has gained widespread attention for its ability to perform natural language processing tasks and has the fastest-growing user base in history. Although ChatGPT has successfully generated theoretical information in multiple fields, its ability to identify and describe emotions is still unknown. Emotional awareness (EA), the ability to conceptualize one’s own and others’ emotions, is considered a transdiagnostic mechanism for psychopathology. This study utilized the Levels of Emotional Awareness Scale (LEAS) as an objective, performance-based test to analyze ChatGPT’s responses to twenty scenarios and compared its EA performance with that of the general population norms, as reported by a previous study. A second examination was performed one month later to measure EA improvement over time. Finally, two independent licensed psychologists evaluated the fit-to-context of ChatGPT’s EA responses. In the first examination, ChatGPT demonstrated significantly higher performance than the general population on all the LEAS scales (Z score = 2.84). In the second examination, ChatGPT’s performance significantly improved, almost reaching the maximum possible LEAS score (Z score = 4.26). Its accuracy levels were also extremely high (9.7/10). The study demonstrated that ChatGPT can generate appropriate EA responses, and that its performance may improve significantly over time. The study has theoretical and clinical implications, as ChatGPT can be used as part of cognitive training for clinical populations with EA impairments. In addition, ChatGPT’s EA-like abilities may facilitate psychiatric diagnosis and assessment and be used to enhance emotional language. Further research is warranted to better understand the potential benefits and risks of ChatGPT and refine it to promote mental health.
format Online
Article
Text
id pubmed-10254409
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-102544092023-06-10 ChatGPT outperforms humans in emotional awareness evaluations Elyoseph, Zohar Hadar-Shoval, Dorit Asraf, Kfir Lvovsky, Maya Front Psychol Psychology The artificial intelligence chatbot, ChatGPT, has gained widespread attention for its ability to perform natural language processing tasks and has the fastest-growing user base in history. Although ChatGPT has successfully generated theoretical information in multiple fields, its ability to identify and describe emotions is still unknown. Emotional awareness (EA), the ability to conceptualize one’s own and others’ emotions, is considered a transdiagnostic mechanism for psychopathology. This study utilized the Levels of Emotional Awareness Scale (LEAS) as an objective, performance-based test to analyze ChatGPT’s responses to twenty scenarios and compared its EA performance with that of the general population norms, as reported by a previous study. A second examination was performed one month later to measure EA improvement over time. Finally, two independent licensed psychologists evaluated the fit-to-context of ChatGPT’s EA responses. In the first examination, ChatGPT demonstrated significantly higher performance than the general population on all the LEAS scales (Z score = 2.84). In the second examination, ChatGPT’s performance significantly improved, almost reaching the maximum possible LEAS score (Z score = 4.26). Its accuracy levels were also extremely high (9.7/10). The study demonstrated that ChatGPT can generate appropriate EA responses, and that its performance may improve significantly over time. The study has theoretical and clinical implications, as ChatGPT can be used as part of cognitive training for clinical populations with EA impairments. In addition, ChatGPT’s EA-like abilities may facilitate psychiatric diagnosis and assessment and be used to enhance emotional language. Further research is warranted to better understand the potential benefits and risks of ChatGPT and refine it to promote mental health. Frontiers Media S.A. 2023-05-26 /pmc/articles/PMC10254409/ /pubmed/37303897 http://dx.doi.org/10.3389/fpsyg.2023.1199058 Text en Copyright © 2023 Elyoseph, Hadar-Shoval, Asraf and Lvovsky. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Psychology
Elyoseph, Zohar
Hadar-Shoval, Dorit
Asraf, Kfir
Lvovsky, Maya
ChatGPT outperforms humans in emotional awareness evaluations
title ChatGPT outperforms humans in emotional awareness evaluations
title_full ChatGPT outperforms humans in emotional awareness evaluations
title_fullStr ChatGPT outperforms humans in emotional awareness evaluations
title_full_unstemmed ChatGPT outperforms humans in emotional awareness evaluations
title_short ChatGPT outperforms humans in emotional awareness evaluations
title_sort chatgpt outperforms humans in emotional awareness evaluations
topic Psychology
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10254409/
https://www.ncbi.nlm.nih.gov/pubmed/37303897
http://dx.doi.org/10.3389/fpsyg.2023.1199058
work_keys_str_mv AT elyosephzohar chatgptoutperformshumansinemotionalawarenessevaluations
AT hadarshovaldorit chatgptoutperformshumansinemotionalawarenessevaluations
AT asrafkfir chatgptoutperformshumansinemotionalawarenessevaluations
AT lvovskymaya chatgptoutperformshumansinemotionalawarenessevaluations