Cargando…
Exploring NLP and Information Extraction to Jointly Address Question Generation and Answering
Question Answering (QA) and Question Generation (QG) have been subjects of an intensive study in recent years and much progress has been made in both areas. However, works on combining these two topics mainly focus on how QG can be used to improve QA results. Through existing Natural Language Proces...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
2020
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7256591/ http://dx.doi.org/10.1007/978-3-030-49186-4_33 |
_version_ | 1783539944634974208 |
---|---|
author | Azevedo, Pedro Leite, Bernardo Cardoso, Henrique Lopes Silva, Daniel Castro Reis, Luís Paulo |
author_facet | Azevedo, Pedro Leite, Bernardo Cardoso, Henrique Lopes Silva, Daniel Castro Reis, Luís Paulo |
author_sort | Azevedo, Pedro |
collection | PubMed |
description | Question Answering (QA) and Question Generation (QG) have been subjects of an intensive study in recent years and much progress has been made in both areas. However, works on combining these two topics mainly focus on how QG can be used to improve QA results. Through existing Natural Language Processing (NLP) techniques, we have implemented a tool that addresses these two topics separately. We further use them jointly in a pipeline. Thus, our goal is to understand how these modules can help each other. For QG, our methodology employs a detailed analysis of the relevant content of a sentence through Part-of-speech (POS) tagging and Named Entity Recognition (NER). Ensuring loose coupling with the QA task, in the latter we use Information Retrieval to rank sentences that might contain relevant information regarding a certain question, together with Open Information Retrieval to analyse the sentences. In its current version, the QG tool takes a sentence to formulate a simple question. By connecting QG with the QA component, we provide a means to effortlessly generate a test set for QA. While our current QA approach shows promising results, when enhancing the QG component we will, in the future, provide questions for which a more elaborated QA will be needed. The generated QA datasets contribute to QA evaluation, while QA proves to be an important technique for assessing the ambiguity of the questions. |
format | Online Article Text |
id | pubmed-7256591 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2020 |
record_format | MEDLINE/PubMed |
spelling | pubmed-72565912020-05-29 Exploring NLP and Information Extraction to Jointly Address Question Generation and Answering Azevedo, Pedro Leite, Bernardo Cardoso, Henrique Lopes Silva, Daniel Castro Reis, Luís Paulo Artificial Intelligence Applications and Innovations Article Question Answering (QA) and Question Generation (QG) have been subjects of an intensive study in recent years and much progress has been made in both areas. However, works on combining these two topics mainly focus on how QG can be used to improve QA results. Through existing Natural Language Processing (NLP) techniques, we have implemented a tool that addresses these two topics separately. We further use them jointly in a pipeline. Thus, our goal is to understand how these modules can help each other. For QG, our methodology employs a detailed analysis of the relevant content of a sentence through Part-of-speech (POS) tagging and Named Entity Recognition (NER). Ensuring loose coupling with the QA task, in the latter we use Information Retrieval to rank sentences that might contain relevant information regarding a certain question, together with Open Information Retrieval to analyse the sentences. In its current version, the QG tool takes a sentence to formulate a simple question. By connecting QG with the QA component, we provide a means to effortlessly generate a test set for QA. While our current QA approach shows promising results, when enhancing the QG component we will, in the future, provide questions for which a more elaborated QA will be needed. The generated QA datasets contribute to QA evaluation, while QA proves to be an important technique for assessing the ambiguity of the questions. 2020-05-06 /pmc/articles/PMC7256591/ http://dx.doi.org/10.1007/978-3-030-49186-4_33 Text en © IFIP International Federation for Information Processing 2020 This article is made available via the PMC Open Access Subset for unrestricted research re-use and secondary analysis in any form or by any means with acknowledgement of the original source. These permissions are granted for the duration of the World Health Organization (WHO) declaration of COVID-19 as a global pandemic. |
spellingShingle | Article Azevedo, Pedro Leite, Bernardo Cardoso, Henrique Lopes Silva, Daniel Castro Reis, Luís Paulo Exploring NLP and Information Extraction to Jointly Address Question Generation and Answering |
title | Exploring NLP and Information Extraction to Jointly Address Question Generation and Answering |
title_full | Exploring NLP and Information Extraction to Jointly Address Question Generation and Answering |
title_fullStr | Exploring NLP and Information Extraction to Jointly Address Question Generation and Answering |
title_full_unstemmed | Exploring NLP and Information Extraction to Jointly Address Question Generation and Answering |
title_short | Exploring NLP and Information Extraction to Jointly Address Question Generation and Answering |
title_sort | exploring nlp and information extraction to jointly address question generation and answering |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7256591/ http://dx.doi.org/10.1007/978-3-030-49186-4_33 |
work_keys_str_mv | AT azevedopedro exploringnlpandinformationextractiontojointlyaddressquestiongenerationandanswering AT leitebernardo exploringnlpandinformationextractiontojointlyaddressquestiongenerationandanswering AT cardosohenriquelopes exploringnlpandinformationextractiontojointlyaddressquestiongenerationandanswering AT silvadanielcastro exploringnlpandinformationextractiontojointlyaddressquestiongenerationandanswering AT reisluispaulo exploringnlpandinformationextractiontojointlyaddressquestiongenerationandanswering |