Cargando…

A Stacked BiLSTM Neural Network Based on Coattention Mechanism for Question Answering

Deep learning is the crucial technology in intelligent question answering research tasks. Nowadays, extensive studies on question answering have been conducted by adopting the methods of deep learning. The challenge is that it not only requires an effective semantic understanding model to generate a...

Descripción completa

Detalles Bibliográficos
Autores principales: Cai, Linqin, Zhou, Sitong, Yan, Xun, Yuan, Rongdi
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Hindawi 2019
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6721247/
https://www.ncbi.nlm.nih.gov/pubmed/31531011
http://dx.doi.org/10.1155/2019/9543490
_version_ 1783448302091501568
author Cai, Linqin
Zhou, Sitong
Yan, Xun
Yuan, Rongdi
author_facet Cai, Linqin
Zhou, Sitong
Yan, Xun
Yuan, Rongdi
author_sort Cai, Linqin
collection PubMed
description Deep learning is the crucial technology in intelligent question answering research tasks. Nowadays, extensive studies on question answering have been conducted by adopting the methods of deep learning. The challenge is that it not only requires an effective semantic understanding model to generate a textual representation but also needs the consideration of semantic interaction between questions and answers simultaneously. In this paper, we propose a stacked Bidirectional Long Short-Term Memory (BiLSTM) neural network based on the coattention mechanism to extract the interaction between questions and answers, combining cosine similarity and Euclidean distance to score the question and answer sentences. Experiments are tested and evaluated on publicly available Text REtrieval Conference (TREC) 8-13 dataset and Wiki-QA dataset. Experimental results confirm that the proposed model is efficient and particularly it achieves a higher mean average precision (MAR) of 0.7613 and mean reciprocal rank (MRR) of 0.8401 on the TREC dataset.
format Online
Article
Text
id pubmed-6721247
institution National Center for Biotechnology Information
language English
publishDate 2019
publisher Hindawi
record_format MEDLINE/PubMed
spelling pubmed-67212472019-09-17 A Stacked BiLSTM Neural Network Based on Coattention Mechanism for Question Answering Cai, Linqin Zhou, Sitong Yan, Xun Yuan, Rongdi Comput Intell Neurosci Research Article Deep learning is the crucial technology in intelligent question answering research tasks. Nowadays, extensive studies on question answering have been conducted by adopting the methods of deep learning. The challenge is that it not only requires an effective semantic understanding model to generate a textual representation but also needs the consideration of semantic interaction between questions and answers simultaneously. In this paper, we propose a stacked Bidirectional Long Short-Term Memory (BiLSTM) neural network based on the coattention mechanism to extract the interaction between questions and answers, combining cosine similarity and Euclidean distance to score the question and answer sentences. Experiments are tested and evaluated on publicly available Text REtrieval Conference (TREC) 8-13 dataset and Wiki-QA dataset. Experimental results confirm that the proposed model is efficient and particularly it achieves a higher mean average precision (MAR) of 0.7613 and mean reciprocal rank (MRR) of 0.8401 on the TREC dataset. Hindawi 2019-08-21 /pmc/articles/PMC6721247/ /pubmed/31531011 http://dx.doi.org/10.1155/2019/9543490 Text en Copyright © 2019 Linqin Cai et al. http://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Research Article
Cai, Linqin
Zhou, Sitong
Yan, Xun
Yuan, Rongdi
A Stacked BiLSTM Neural Network Based on Coattention Mechanism for Question Answering
title A Stacked BiLSTM Neural Network Based on Coattention Mechanism for Question Answering
title_full A Stacked BiLSTM Neural Network Based on Coattention Mechanism for Question Answering
title_fullStr A Stacked BiLSTM Neural Network Based on Coattention Mechanism for Question Answering
title_full_unstemmed A Stacked BiLSTM Neural Network Based on Coattention Mechanism for Question Answering
title_short A Stacked BiLSTM Neural Network Based on Coattention Mechanism for Question Answering
title_sort stacked bilstm neural network based on coattention mechanism for question answering
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6721247/
https://www.ncbi.nlm.nih.gov/pubmed/31531011
http://dx.doi.org/10.1155/2019/9543490
work_keys_str_mv AT cailinqin astackedbilstmneuralnetworkbasedoncoattentionmechanismforquestionanswering
AT zhousitong astackedbilstmneuralnetworkbasedoncoattentionmechanismforquestionanswering
AT yanxun astackedbilstmneuralnetworkbasedoncoattentionmechanismforquestionanswering
AT yuanrongdi astackedbilstmneuralnetworkbasedoncoattentionmechanismforquestionanswering
AT cailinqin stackedbilstmneuralnetworkbasedoncoattentionmechanismforquestionanswering
AT zhousitong stackedbilstmneuralnetworkbasedoncoattentionmechanismforquestionanswering
AT yanxun stackedbilstmneuralnetworkbasedoncoattentionmechanismforquestionanswering
AT yuanrongdi stackedbilstmneuralnetworkbasedoncoattentionmechanismforquestionanswering