Cargando…

KRP-DS: A Knowledge Graph-Based Dialogue System with Inference-Aided Prediction

With the popularity of ChatGPT, there has been increasing attention towards dialogue systems. Researchers are dedicated to designing a knowledgeable model that can engage in conversations like humans. Traditional seq2seq dialogue models often suffer from limited performance and the issue of generati...

Descripción completa

Detalles Bibliográficos
Autores principales: He, Qiang, Xu, Shuobo, Zhu, Zhenfang, Wang, Peng, Li, Kefeng, Zheng, Quanfeng, Li, Yanshun
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10422325/
https://www.ncbi.nlm.nih.gov/pubmed/37571587
http://dx.doi.org/10.3390/s23156805
_version_ 1785089181428482048
author He, Qiang
Xu, Shuobo
Zhu, Zhenfang
Wang, Peng
Li, Kefeng
Zheng, Quanfeng
Li, Yanshun
author_facet He, Qiang
Xu, Shuobo
Zhu, Zhenfang
Wang, Peng
Li, Kefeng
Zheng, Quanfeng
Li, Yanshun
author_sort He, Qiang
collection PubMed
description With the popularity of ChatGPT, there has been increasing attention towards dialogue systems. Researchers are dedicated to designing a knowledgeable model that can engage in conversations like humans. Traditional seq2seq dialogue models often suffer from limited performance and the issue of generating safe responses. In recent years, large-scale pretrained language models have demonstrated their powerful capabilities across various domains. Many studies have leveraged these pretrained models for dialogue tasks to address concerns such as safe response generation. Pretrained models can enhance responses by carrying certain knowledge information after being pre-trained on large-scale data. However, when specific knowledge is required in a particular domain, the model may still generate bland or inappropriate responses, and the interpretability of such models is poor. Therefore, in this paper, we propose the KRP-DS model. We design a knowledge module that incorporates a knowledge graph as external knowledge in the dialogue system. The module utilizes contextual information for path reasoning and guides knowledge prediction. Finally, the predicted knowledge is used to enhance response generation. Experimental results show that our proposed model can effectively improve the quality and diversity of responses while having better interpretability, and outperforms baseline models in both automatic and human evaluations.
format Online
Article
Text
id pubmed-10422325
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-104223252023-08-13 KRP-DS: A Knowledge Graph-Based Dialogue System with Inference-Aided Prediction He, Qiang Xu, Shuobo Zhu, Zhenfang Wang, Peng Li, Kefeng Zheng, Quanfeng Li, Yanshun Sensors (Basel) Article With the popularity of ChatGPT, there has been increasing attention towards dialogue systems. Researchers are dedicated to designing a knowledgeable model that can engage in conversations like humans. Traditional seq2seq dialogue models often suffer from limited performance and the issue of generating safe responses. In recent years, large-scale pretrained language models have demonstrated their powerful capabilities across various domains. Many studies have leveraged these pretrained models for dialogue tasks to address concerns such as safe response generation. Pretrained models can enhance responses by carrying certain knowledge information after being pre-trained on large-scale data. However, when specific knowledge is required in a particular domain, the model may still generate bland or inappropriate responses, and the interpretability of such models is poor. Therefore, in this paper, we propose the KRP-DS model. We design a knowledge module that incorporates a knowledge graph as external knowledge in the dialogue system. The module utilizes contextual information for path reasoning and guides knowledge prediction. Finally, the predicted knowledge is used to enhance response generation. Experimental results show that our proposed model can effectively improve the quality and diversity of responses while having better interpretability, and outperforms baseline models in both automatic and human evaluations. MDPI 2023-07-30 /pmc/articles/PMC10422325/ /pubmed/37571587 http://dx.doi.org/10.3390/s23156805 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
He, Qiang
Xu, Shuobo
Zhu, Zhenfang
Wang, Peng
Li, Kefeng
Zheng, Quanfeng
Li, Yanshun
KRP-DS: A Knowledge Graph-Based Dialogue System with Inference-Aided Prediction
title KRP-DS: A Knowledge Graph-Based Dialogue System with Inference-Aided Prediction
title_full KRP-DS: A Knowledge Graph-Based Dialogue System with Inference-Aided Prediction
title_fullStr KRP-DS: A Knowledge Graph-Based Dialogue System with Inference-Aided Prediction
title_full_unstemmed KRP-DS: A Knowledge Graph-Based Dialogue System with Inference-Aided Prediction
title_short KRP-DS: A Knowledge Graph-Based Dialogue System with Inference-Aided Prediction
title_sort krp-ds: a knowledge graph-based dialogue system with inference-aided prediction
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10422325/
https://www.ncbi.nlm.nih.gov/pubmed/37571587
http://dx.doi.org/10.3390/s23156805
work_keys_str_mv AT heqiang krpdsaknowledgegraphbaseddialoguesystemwithinferenceaidedprediction
AT xushuobo krpdsaknowledgegraphbaseddialoguesystemwithinferenceaidedprediction
AT zhuzhenfang krpdsaknowledgegraphbaseddialoguesystemwithinferenceaidedprediction
AT wangpeng krpdsaknowledgegraphbaseddialoguesystemwithinferenceaidedprediction
AT likefeng krpdsaknowledgegraphbaseddialoguesystemwithinferenceaidedprediction
AT zhengquanfeng krpdsaknowledgegraphbaseddialoguesystemwithinferenceaidedprediction
AT liyanshun krpdsaknowledgegraphbaseddialoguesystemwithinferenceaidedprediction