A Cooking Knowledge Graph and Benchmark for Question Answering Evaluation in Lifelong Learning Scenarios

In a long term exploitation environment, a Question Answering (QA) system should maintain or even improve its performance over time, trying to overcome the lacks made evident through the interactions with users. We claim that, in order to make progress in the QA over Knowledge Bases (KBs) research f...

Descripción completa

Detalles Bibliográficos
Autores principales: Veron, Mathilde, Peñas, Anselmo, Echegoyen, Guillermo, Banerjee, Somnath, Ghannay, Sahar, Rosset, Sophie
Formato: Online Artículo Texto
Lenguaje:English
Publicado: 2020
Materias:
Article
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7298188/
http://dx.doi.org/10.1007/978-3-030-51310-8_9
_version_ 1783547165472194560
author Veron, Mathilde
Peñas, Anselmo
Echegoyen, Guillermo
Banerjee, Somnath
Ghannay, Sahar
Rosset, Sophie
author_facet Veron, Mathilde
Peñas, Anselmo
Echegoyen, Guillermo
Banerjee, Somnath
Ghannay, Sahar
Rosset, Sophie
author_sort Veron, Mathilde
collection PubMed
description In a long term exploitation environment, a Question Answering (QA) system should maintain or even improve its performance over time, trying to overcome the lacks made evident through the interactions with users. We claim that, in order to make progress in the QA over Knowledge Bases (KBs) research field, we must deal with two problems at the same time: the translation of Natural Language (NL) questions into formal queries, and the detection of missing knowledge that impact the way a question is answered. The research on these two challenges has not been addressed jointly until now, what motivates the main goals of this work: (i) the definition of the problem and (ii) the development of a methodology to create the evaluation resources needed to address this challenge.
format Online
Article
Text
id pubmed-7298188
institution National Center for Biotechnology Information
language English
publishDate 2020
record_format MEDLINE/PubMed
spelling pubmed-72981882020-06-17 A Cooking Knowledge Graph and Benchmark for Question Answering Evaluation in Lifelong Learning Scenarios Veron, Mathilde Peñas, Anselmo Echegoyen, Guillermo Banerjee, Somnath Ghannay, Sahar Rosset, Sophie Natural Language Processing and Information Systems Article In a long term exploitation environment, a Question Answering (QA) system should maintain or even improve its performance over time, trying to overcome the lacks made evident through the interactions with users. We claim that, in order to make progress in the QA over Knowledge Bases (KBs) research field, we must deal with two problems at the same time: the translation of Natural Language (NL) questions into formal queries, and the detection of missing knowledge that impact the way a question is answered. The research on these two challenges has not been addressed jointly until now, what motivates the main goals of this work: (i) the definition of the problem and (ii) the development of a methodology to create the evaluation resources needed to address this challenge. 2020-05-26 /pmc/articles/PMC7298188/ http://dx.doi.org/10.1007/978-3-030-51310-8_9 Text en © Springer Nature Switzerland AG 2020 This article is made available via the PMC Open Access Subset for unrestricted research re-use and secondary analysis in any form or by any means with acknowledgement of the original source. These permissions are granted for the duration of the World Health Organization (WHO) declaration of COVID-19 as a global pandemic.
spellingShingle Article
Veron, Mathilde
Peñas, Anselmo
Echegoyen, Guillermo
Banerjee, Somnath
Ghannay, Sahar
Rosset, Sophie
A Cooking Knowledge Graph and Benchmark for Question Answering Evaluation in Lifelong Learning Scenarios
title A Cooking Knowledge Graph and Benchmark for Question Answering Evaluation in Lifelong Learning Scenarios
title_full A Cooking Knowledge Graph and Benchmark for Question Answering Evaluation in Lifelong Learning Scenarios
title_fullStr A Cooking Knowledge Graph and Benchmark for Question Answering Evaluation in Lifelong Learning Scenarios
title_full_unstemmed A Cooking Knowledge Graph and Benchmark for Question Answering Evaluation in Lifelong Learning Scenarios
title_short A Cooking Knowledge Graph and Benchmark for Question Answering Evaluation in Lifelong Learning Scenarios
title_sort cooking knowledge graph and benchmark for question answering evaluation in lifelong learning scenarios
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7298188/
http://dx.doi.org/10.1007/978-3-030-51310-8_9
work_keys_str_mv AT veronmathilde acookingknowledgegraphandbenchmarkforquestionansweringevaluationinlifelonglearningscenarios
AT penasanselmo acookingknowledgegraphandbenchmarkforquestionansweringevaluationinlifelonglearningscenarios
AT echegoyenguillermo acookingknowledgegraphandbenchmarkforquestionansweringevaluationinlifelonglearningscenarios
AT banerjeesomnath acookingknowledgegraphandbenchmarkforquestionansweringevaluationinlifelonglearningscenarios
AT ghannaysahar acookingknowledgegraphandbenchmarkforquestionansweringevaluationinlifelonglearningscenarios
AT rossetsophie acookingknowledgegraphandbenchmarkforquestionansweringevaluationinlifelonglearningscenarios
AT veronmathilde cookingknowledgegraphandbenchmarkforquestionansweringevaluationinlifelonglearningscenarios
AT penasanselmo cookingknowledgegraphandbenchmarkforquestionansweringevaluationinlifelonglearningscenarios
AT echegoyenguillermo cookingknowledgegraphandbenchmarkforquestionansweringevaluationinlifelonglearningscenarios
AT banerjeesomnath cookingknowledgegraphandbenchmarkforquestionansweringevaluationinlifelonglearningscenarios
AT ghannaysahar cookingknowledgegraphandbenchmarkforquestionansweringevaluationinlifelonglearningscenarios
AT rossetsophie cookingknowledgegraphandbenchmarkforquestionansweringevaluationinlifelonglearningscenarios

Ejemplares similares