Cargando…

Trust and Cooperation

We AI researchers are concerned about the potential impact of artificially intelligent systems on humanity. In the first half of this essay, I argue that ethics is an evolved body of cultural knowledge that (among other things) encourages individual behavior that promotes the welfare of the society...

Descripción completa

Detalles Bibliográficos
Autor principal: Kuipers, Benjamin
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9100567/
https://www.ncbi.nlm.nih.gov/pubmed/35572370
http://dx.doi.org/10.3389/frobt.2022.676767
_version_ 1784706876930260992
author Kuipers, Benjamin
author_facet Kuipers, Benjamin
author_sort Kuipers, Benjamin
collection PubMed
description We AI researchers are concerned about the potential impact of artificially intelligent systems on humanity. In the first half of this essay, I argue that ethics is an evolved body of cultural knowledge that (among other things) encourages individual behavior that promotes the welfare of the society (which in turn promotes the welfare of its individual members). The causal paths involved suggest that trust and cooperation play key roles in this process. In the second half of the essay, I consider whether the key role of trust exposes our society to existential threats. This possibility arises because decision-making agents (humans, AIs, and others) necessarily rely on simplified models to cope with the unbounded complexity of our physical and social world. By selecting actions to maximize a utility measure, a well-formulated game theory model can be a powerful and valuable tool. However, a poorly-formulated game theory model may be uniquely harmful, in cases where the action it recommends deliberately exploits the vulnerability and violates the trust of cooperative partners. Widespread use of such models can erode the overall levels of trust in the society. Cooperation is reduced, resources are constrained, and there is less ability to meet challenges or take advantage of opportunities. Loss of trust will affect humanity’s ability to respond to existential threats such as climate change.
format Online
Article
Text
id pubmed-9100567
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-91005672022-05-14 Trust and Cooperation Kuipers, Benjamin Front Robot AI Robotics and AI We AI researchers are concerned about the potential impact of artificially intelligent systems on humanity. In the first half of this essay, I argue that ethics is an evolved body of cultural knowledge that (among other things) encourages individual behavior that promotes the welfare of the society (which in turn promotes the welfare of its individual members). The causal paths involved suggest that trust and cooperation play key roles in this process. In the second half of the essay, I consider whether the key role of trust exposes our society to existential threats. This possibility arises because decision-making agents (humans, AIs, and others) necessarily rely on simplified models to cope with the unbounded complexity of our physical and social world. By selecting actions to maximize a utility measure, a well-formulated game theory model can be a powerful and valuable tool. However, a poorly-formulated game theory model may be uniquely harmful, in cases where the action it recommends deliberately exploits the vulnerability and violates the trust of cooperative partners. Widespread use of such models can erode the overall levels of trust in the society. Cooperation is reduced, resources are constrained, and there is less ability to meet challenges or take advantage of opportunities. Loss of trust will affect humanity’s ability to respond to existential threats such as climate change. Frontiers Media S.A. 2022-04-29 /pmc/articles/PMC9100567/ /pubmed/35572370 http://dx.doi.org/10.3389/frobt.2022.676767 Text en Copyright © 2022 Kuipers. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Robotics and AI
Kuipers, Benjamin
Trust and Cooperation
title Trust and Cooperation
title_full Trust and Cooperation
title_fullStr Trust and Cooperation
title_full_unstemmed Trust and Cooperation
title_short Trust and Cooperation
title_sort trust and cooperation
topic Robotics and AI
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9100567/
https://www.ncbi.nlm.nih.gov/pubmed/35572370
http://dx.doi.org/10.3389/frobt.2022.676767
work_keys_str_mv AT kuipersbenjamin trustandcooperation