Cargando…

Question answering system using Q & A site corpus Query expansion and answer candidate evaluation

Question Answering (QA) is a task of answering natural language questions with adequate sentences. This paper proposes two methods to improve the performance of the QA system using a Q&A site corpus. The first method is for the relevant document retrieval module. We proposed modification of meas...

Descripción completa

Detalles Bibliográficos
Autores principales: Komiya, Kanako, Abe, Yuji, Morita, Hajime, Kotani, Yoshiyuki
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer International Publishing 2013
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3825096/
https://www.ncbi.nlm.nih.gov/pubmed/24255824
http://dx.doi.org/10.1186/2193-1801-2-396
_version_ 1782290768192339968
author Komiya, Kanako
Abe, Yuji
Morita, Hajime
Kotani, Yoshiyuki
author_facet Komiya, Kanako
Abe, Yuji
Morita, Hajime
Kotani, Yoshiyuki
author_sort Komiya, Kanako
collection PubMed
description Question Answering (QA) is a task of answering natural language questions with adequate sentences. This paper proposes two methods to improve the performance of the QA system using a Q&A site corpus. The first method is for the relevant document retrieval module. We proposed modification of measure of mutual information for the query expansion; we calculate it between two words in each question and a word in its answer in the Q&A site corpus not to choose the words that are not suitable. The second method is for the candidate answer evaluation module. We proposed to evaluate candidate answers using the two measures together, i.e., the Web relevance score and the translation probability. The experiments were carried out using a Japanese Q&A site corpus. They revealed that the first proposed method was significantly better than the original method when their accuracies and MRR (Mean Reciprocal Rank) were compared and the second method was significantly better than the original methods when their MRR were compared.
format Online
Article
Text
id pubmed-3825096
institution National Center for Biotechnology Information
language English
publishDate 2013
publisher Springer International Publishing
record_format MEDLINE/PubMed
spelling pubmed-38250962013-11-19 Question answering system using Q & A site corpus Query expansion and answer candidate evaluation Komiya, Kanako Abe, Yuji Morita, Hajime Kotani, Yoshiyuki Springerplus Research Question Answering (QA) is a task of answering natural language questions with adequate sentences. This paper proposes two methods to improve the performance of the QA system using a Q&A site corpus. The first method is for the relevant document retrieval module. We proposed modification of measure of mutual information for the query expansion; we calculate it between two words in each question and a word in its answer in the Q&A site corpus not to choose the words that are not suitable. The second method is for the candidate answer evaluation module. We proposed to evaluate candidate answers using the two measures together, i.e., the Web relevance score and the translation probability. The experiments were carried out using a Japanese Q&A site corpus. They revealed that the first proposed method was significantly better than the original method when their accuracies and MRR (Mean Reciprocal Rank) were compared and the second method was significantly better than the original methods when their MRR were compared. Springer International Publishing 2013-08-22 /pmc/articles/PMC3825096/ /pubmed/24255824 http://dx.doi.org/10.1186/2193-1801-2-396 Text en © Komiya et al.; licensee Springer. 2013 This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Research
Komiya, Kanako
Abe, Yuji
Morita, Hajime
Kotani, Yoshiyuki
Question answering system using Q & A site corpus Query expansion and answer candidate evaluation
title Question answering system using Q & A site corpus Query expansion and answer candidate evaluation
title_full Question answering system using Q & A site corpus Query expansion and answer candidate evaluation
title_fullStr Question answering system using Q & A site corpus Query expansion and answer candidate evaluation
title_full_unstemmed Question answering system using Q & A site corpus Query expansion and answer candidate evaluation
title_short Question answering system using Q & A site corpus Query expansion and answer candidate evaluation
title_sort question answering system using q & a site corpus query expansion and answer candidate evaluation
topic Research
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3825096/
https://www.ncbi.nlm.nih.gov/pubmed/24255824
http://dx.doi.org/10.1186/2193-1801-2-396
work_keys_str_mv AT komiyakanako questionansweringsystemusingqasitecorpusqueryexpansionandanswercandidateevaluation
AT abeyuji questionansweringsystemusingqasitecorpusqueryexpansionandanswercandidateevaluation
AT moritahajime questionansweringsystemusingqasitecorpusqueryexpansionandanswercandidateevaluation
AT kotaniyoshiyuki questionansweringsystemusingqasitecorpusqueryexpansionandanswercandidateevaluation