Cargando…
Symbol Emergence as an Interpersonal Multimodal Categorization
This study focuses on category formation for individual agents and the dynamics of symbol emergence in a multi-agent system through semiotic communication. In this study, the semiotic communication refers to exchanging signs composed of the signifier (i.e., words) and the signified (i.e., categories...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2019
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7805687/ https://www.ncbi.nlm.nih.gov/pubmed/33501149 http://dx.doi.org/10.3389/frobt.2019.00134 |
_version_ | 1783636357319491584 |
---|---|
author | Hagiwara, Yoshinobu Kobayashi, Hiroyoshi Taniguchi, Akira Taniguchi, Tadahiro |
author_facet | Hagiwara, Yoshinobu Kobayashi, Hiroyoshi Taniguchi, Akira Taniguchi, Tadahiro |
author_sort | Hagiwara, Yoshinobu |
collection | PubMed |
description | This study focuses on category formation for individual agents and the dynamics of symbol emergence in a multi-agent system through semiotic communication. In this study, the semiotic communication refers to exchanging signs composed of the signifier (i.e., words) and the signified (i.e., categories). We define the generation and interpretation of signs associated with the categories formed through the agent's own sensory experience or by exchanging signs with other agents as basic functions of the semiotic communication. From the viewpoint of language evolution and symbol emergence, organization of a symbol system in a multi-agent system (i.e., agent society) is considered as a bottom-up and dynamic process, where individual agents share the meaning of signs and categorize sensory experience. A constructive computational model can explain the mutual dependency of the two processes and has mathematical support that guarantees a symbol system's emergence and sharing within the multi-agent system. In this paper, we describe a new computational model that represents symbol emergence in a two-agent system based on a probabilistic generative model for multimodal categorization. It models semiotic communication via a probabilistic rejection based on the receiver's own belief. We have found that the dynamics by which cognitively independent agents create a symbol system through their semiotic communication can be regarded as the inference process of a hidden variable in an interpersonal multimodal categorizer, i.e., the complete system can be regarded as a single agent performing multimodal categorization using the sensors of all agents, if we define the rejection probability based on the Metropolis-Hastings algorithm. The validity of the proposed model and algorithm for symbol emergence, i.e., forming and sharing signs and categories, is also verified in an experiment with two agents observing daily objects in the real-world environment. In the experiment, we compared three communication algorithms: no communication, no rejection, and the proposed algorithm. The experimental results demonstrate that our model reproduces the phenomena of symbol emergence, which does not require a teacher who would know a pre-existing symbol system. Instead, the multi-agent system can form and use a symbol system without having pre-existing categories. |
format | Online Article Text |
id | pubmed-7805687 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2019 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-78056872021-01-25 Symbol Emergence as an Interpersonal Multimodal Categorization Hagiwara, Yoshinobu Kobayashi, Hiroyoshi Taniguchi, Akira Taniguchi, Tadahiro Front Robot AI Robotics and AI This study focuses on category formation for individual agents and the dynamics of symbol emergence in a multi-agent system through semiotic communication. In this study, the semiotic communication refers to exchanging signs composed of the signifier (i.e., words) and the signified (i.e., categories). We define the generation and interpretation of signs associated with the categories formed through the agent's own sensory experience or by exchanging signs with other agents as basic functions of the semiotic communication. From the viewpoint of language evolution and symbol emergence, organization of a symbol system in a multi-agent system (i.e., agent society) is considered as a bottom-up and dynamic process, where individual agents share the meaning of signs and categorize sensory experience. A constructive computational model can explain the mutual dependency of the two processes and has mathematical support that guarantees a symbol system's emergence and sharing within the multi-agent system. In this paper, we describe a new computational model that represents symbol emergence in a two-agent system based on a probabilistic generative model for multimodal categorization. It models semiotic communication via a probabilistic rejection based on the receiver's own belief. We have found that the dynamics by which cognitively independent agents create a symbol system through their semiotic communication can be regarded as the inference process of a hidden variable in an interpersonal multimodal categorizer, i.e., the complete system can be regarded as a single agent performing multimodal categorization using the sensors of all agents, if we define the rejection probability based on the Metropolis-Hastings algorithm. The validity of the proposed model and algorithm for symbol emergence, i.e., forming and sharing signs and categories, is also verified in an experiment with two agents observing daily objects in the real-world environment. In the experiment, we compared three communication algorithms: no communication, no rejection, and the proposed algorithm. The experimental results demonstrate that our model reproduces the phenomena of symbol emergence, which does not require a teacher who would know a pre-existing symbol system. Instead, the multi-agent system can form and use a symbol system without having pre-existing categories. Frontiers Media S.A. 2019-12-10 /pmc/articles/PMC7805687/ /pubmed/33501149 http://dx.doi.org/10.3389/frobt.2019.00134 Text en Copyright © 2019 Hagiwara, Kobayashi, Taniguchi and Taniguchi. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Robotics and AI Hagiwara, Yoshinobu Kobayashi, Hiroyoshi Taniguchi, Akira Taniguchi, Tadahiro Symbol Emergence as an Interpersonal Multimodal Categorization |
title | Symbol Emergence as an Interpersonal Multimodal Categorization |
title_full | Symbol Emergence as an Interpersonal Multimodal Categorization |
title_fullStr | Symbol Emergence as an Interpersonal Multimodal Categorization |
title_full_unstemmed | Symbol Emergence as an Interpersonal Multimodal Categorization |
title_short | Symbol Emergence as an Interpersonal Multimodal Categorization |
title_sort | symbol emergence as an interpersonal multimodal categorization |
topic | Robotics and AI |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7805687/ https://www.ncbi.nlm.nih.gov/pubmed/33501149 http://dx.doi.org/10.3389/frobt.2019.00134 |
work_keys_str_mv | AT hagiwarayoshinobu symbolemergenceasaninterpersonalmultimodalcategorization AT kobayashihiroyoshi symbolemergenceasaninterpersonalmultimodalcategorization AT taniguchiakira symbolemergenceasaninterpersonalmultimodalcategorization AT taniguchitadahiro symbolemergenceasaninterpersonalmultimodalcategorization |