Cargando…

A Quantum Model of Trust Calibration in Human–AI Interactions

This exploratory study investigates a human agent’s evolving judgements of reliability when interacting with an AI system. Two aims drove this investigation: (1) compare the predictive performance of quantum vs. Markov random walk models regarding human reliability judgements of an AI system and (2)...

Descripción completa

Detalles Bibliográficos
Autores principales: Roeder, Luisa, Hoyte, Pamela, van der Meer, Johan, Fell, Lauren, Johnston, Patrick, Kerr, Graham, Bruza, Peter
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10528121/
https://www.ncbi.nlm.nih.gov/pubmed/37761661
http://dx.doi.org/10.3390/e25091362
_version_ 1785111226372587520
author Roeder, Luisa
Hoyte, Pamela
van der Meer, Johan
Fell, Lauren
Johnston, Patrick
Kerr, Graham
Bruza, Peter
author_facet Roeder, Luisa
Hoyte, Pamela
van der Meer, Johan
Fell, Lauren
Johnston, Patrick
Kerr, Graham
Bruza, Peter
author_sort Roeder, Luisa
collection PubMed
description This exploratory study investigates a human agent’s evolving judgements of reliability when interacting with an AI system. Two aims drove this investigation: (1) compare the predictive performance of quantum vs. Markov random walk models regarding human reliability judgements of an AI system and (2) identify a neural correlate of the perturbation of a human agent’s judgement of the AI’s reliability. As AI becomes more prevalent, it is important to understand how humans trust these technologies and how trust evolves when interacting with them. A mixed-methods experiment was developed for exploring reliability calibration in human–AI interactions. The behavioural data collected were used as a baseline to assess the predictive performance of the quantum and Markov models. We found the quantum model to better predict the evolving reliability ratings than the Markov model. This may be due to the quantum model being more amenable to represent the sometimes pronounced within-subject variability of reliability ratings. Additionally, a clear event-related potential response was found in the electroencephalographic (EEG) data, which is attributed to the expectations of reliability being perturbed. The identification of a trust-related EEG-based measure opens the door to explore how it could be used to adapt the parameters of the quantum model in real time.
format Online
Article
Text
id pubmed-10528121
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-105281212023-09-28 A Quantum Model of Trust Calibration in Human–AI Interactions Roeder, Luisa Hoyte, Pamela van der Meer, Johan Fell, Lauren Johnston, Patrick Kerr, Graham Bruza, Peter Entropy (Basel) Article This exploratory study investigates a human agent’s evolving judgements of reliability when interacting with an AI system. Two aims drove this investigation: (1) compare the predictive performance of quantum vs. Markov random walk models regarding human reliability judgements of an AI system and (2) identify a neural correlate of the perturbation of a human agent’s judgement of the AI’s reliability. As AI becomes more prevalent, it is important to understand how humans trust these technologies and how trust evolves when interacting with them. A mixed-methods experiment was developed for exploring reliability calibration in human–AI interactions. The behavioural data collected were used as a baseline to assess the predictive performance of the quantum and Markov models. We found the quantum model to better predict the evolving reliability ratings than the Markov model. This may be due to the quantum model being more amenable to represent the sometimes pronounced within-subject variability of reliability ratings. Additionally, a clear event-related potential response was found in the electroencephalographic (EEG) data, which is attributed to the expectations of reliability being perturbed. The identification of a trust-related EEG-based measure opens the door to explore how it could be used to adapt the parameters of the quantum model in real time. MDPI 2023-09-20 /pmc/articles/PMC10528121/ /pubmed/37761661 http://dx.doi.org/10.3390/e25091362 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Roeder, Luisa
Hoyte, Pamela
van der Meer, Johan
Fell, Lauren
Johnston, Patrick
Kerr, Graham
Bruza, Peter
A Quantum Model of Trust Calibration in Human–AI Interactions
title A Quantum Model of Trust Calibration in Human–AI Interactions
title_full A Quantum Model of Trust Calibration in Human–AI Interactions
title_fullStr A Quantum Model of Trust Calibration in Human–AI Interactions
title_full_unstemmed A Quantum Model of Trust Calibration in Human–AI Interactions
title_short A Quantum Model of Trust Calibration in Human–AI Interactions
title_sort quantum model of trust calibration in human–ai interactions
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10528121/
https://www.ncbi.nlm.nih.gov/pubmed/37761661
http://dx.doi.org/10.3390/e25091362
work_keys_str_mv AT roederluisa aquantummodeloftrustcalibrationinhumanaiinteractions
AT hoytepamela aquantummodeloftrustcalibrationinhumanaiinteractions
AT vandermeerjohan aquantummodeloftrustcalibrationinhumanaiinteractions
AT felllauren aquantummodeloftrustcalibrationinhumanaiinteractions
AT johnstonpatrick aquantummodeloftrustcalibrationinhumanaiinteractions
AT kerrgraham aquantummodeloftrustcalibrationinhumanaiinteractions
AT bruzapeter aquantummodeloftrustcalibrationinhumanaiinteractions
AT roederluisa quantummodeloftrustcalibrationinhumanaiinteractions
AT hoytepamela quantummodeloftrustcalibrationinhumanaiinteractions
AT vandermeerjohan quantummodeloftrustcalibrationinhumanaiinteractions
AT felllauren quantummodeloftrustcalibrationinhumanaiinteractions
AT johnstonpatrick quantummodeloftrustcalibrationinhumanaiinteractions
AT kerrgraham quantummodeloftrustcalibrationinhumanaiinteractions
AT bruzapeter quantummodeloftrustcalibrationinhumanaiinteractions