Cargando…

Exploring NLP and Information Extraction to Jointly Address Question Generation and Answering

Question Answering (QA) and Question Generation (QG) have been subjects of an intensive study in recent years and much progress has been made in both areas. However, works on combining these two topics mainly focus on how QG can be used to improve QA results. Through existing Natural Language Proces...

Descripción completa

Detalles Bibliográficos
Autores principales: Azevedo, Pedro, Leite, Bernardo, Cardoso, Henrique Lopes, Silva, Daniel Castro, Reis, Luís Paulo
Formato: Online Artículo Texto
Lenguaje:English
Publicado: 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7256591/
http://dx.doi.org/10.1007/978-3-030-49186-4_33
_version_ 1783539944634974208
author Azevedo, Pedro
Leite, Bernardo
Cardoso, Henrique Lopes
Silva, Daniel Castro
Reis, Luís Paulo
author_facet Azevedo, Pedro
Leite, Bernardo
Cardoso, Henrique Lopes
Silva, Daniel Castro
Reis, Luís Paulo
author_sort Azevedo, Pedro
collection PubMed
description Question Answering (QA) and Question Generation (QG) have been subjects of an intensive study in recent years and much progress has been made in both areas. However, works on combining these two topics mainly focus on how QG can be used to improve QA results. Through existing Natural Language Processing (NLP) techniques, we have implemented a tool that addresses these two topics separately. We further use them jointly in a pipeline. Thus, our goal is to understand how these modules can help each other. For QG, our methodology employs a detailed analysis of the relevant content of a sentence through Part-of-speech (POS) tagging and Named Entity Recognition (NER). Ensuring loose coupling with the QA task, in the latter we use Information Retrieval to rank sentences that might contain relevant information regarding a certain question, together with Open Information Retrieval to analyse the sentences. In its current version, the QG tool takes a sentence to formulate a simple question. By connecting QG with the QA component, we provide a means to effortlessly generate a test set for QA. While our current QA approach shows promising results, when enhancing the QG component we will, in the future, provide questions for which a more elaborated QA will be needed. The generated QA datasets contribute to QA evaluation, while QA proves to be an important technique for assessing the ambiguity of the questions.
format Online
Article
Text
id pubmed-7256591
institution National Center for Biotechnology Information
language English
publishDate 2020
record_format MEDLINE/PubMed
spelling pubmed-72565912020-05-29 Exploring NLP and Information Extraction to Jointly Address Question Generation and Answering Azevedo, Pedro Leite, Bernardo Cardoso, Henrique Lopes Silva, Daniel Castro Reis, Luís Paulo Artificial Intelligence Applications and Innovations Article Question Answering (QA) and Question Generation (QG) have been subjects of an intensive study in recent years and much progress has been made in both areas. However, works on combining these two topics mainly focus on how QG can be used to improve QA results. Through existing Natural Language Processing (NLP) techniques, we have implemented a tool that addresses these two topics separately. We further use them jointly in a pipeline. Thus, our goal is to understand how these modules can help each other. For QG, our methodology employs a detailed analysis of the relevant content of a sentence through Part-of-speech (POS) tagging and Named Entity Recognition (NER). Ensuring loose coupling with the QA task, in the latter we use Information Retrieval to rank sentences that might contain relevant information regarding a certain question, together with Open Information Retrieval to analyse the sentences. In its current version, the QG tool takes a sentence to formulate a simple question. By connecting QG with the QA component, we provide a means to effortlessly generate a test set for QA. While our current QA approach shows promising results, when enhancing the QG component we will, in the future, provide questions for which a more elaborated QA will be needed. The generated QA datasets contribute to QA evaluation, while QA proves to be an important technique for assessing the ambiguity of the questions. 2020-05-06 /pmc/articles/PMC7256591/ http://dx.doi.org/10.1007/978-3-030-49186-4_33 Text en © IFIP International Federation for Information Processing 2020 This article is made available via the PMC Open Access Subset for unrestricted research re-use and secondary analysis in any form or by any means with acknowledgement of the original source. These permissions are granted for the duration of the World Health Organization (WHO) declaration of COVID-19 as a global pandemic.
spellingShingle Article
Azevedo, Pedro
Leite, Bernardo
Cardoso, Henrique Lopes
Silva, Daniel Castro
Reis, Luís Paulo
Exploring NLP and Information Extraction to Jointly Address Question Generation and Answering
title Exploring NLP and Information Extraction to Jointly Address Question Generation and Answering
title_full Exploring NLP and Information Extraction to Jointly Address Question Generation and Answering
title_fullStr Exploring NLP and Information Extraction to Jointly Address Question Generation and Answering
title_full_unstemmed Exploring NLP and Information Extraction to Jointly Address Question Generation and Answering
title_short Exploring NLP and Information Extraction to Jointly Address Question Generation and Answering
title_sort exploring nlp and information extraction to jointly address question generation and answering
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7256591/
http://dx.doi.org/10.1007/978-3-030-49186-4_33
work_keys_str_mv AT azevedopedro exploringnlpandinformationextractiontojointlyaddressquestiongenerationandanswering
AT leitebernardo exploringnlpandinformationextractiontojointlyaddressquestiongenerationandanswering
AT cardosohenriquelopes exploringnlpandinformationextractiontojointlyaddressquestiongenerationandanswering
AT silvadanielcastro exploringnlpandinformationextractiontojointlyaddressquestiongenerationandanswering
AT reisluispaulo exploringnlpandinformationextractiontojointlyaddressquestiongenerationandanswering