Cargando…

Deep learning-based approach for Arabic open domain question answering

Open-domain question answering (OpenQA) is one of the most challenging yet widely investigated problems in natural language processing. It aims at building a system that can answer any given question from large-scale unstructured text or structured knowledge-base. To solve this problem, researchers...

Descripción completa

Detalles Bibliográficos
Autores principales: Alsubhi, Kholoud, Jamal, Amani, Alhothali, Areej
Formato: Online Artículo Texto
Lenguaje:English
Publicado: PeerJ Inc. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9138168/
https://www.ncbi.nlm.nih.gov/pubmed/35634104
http://dx.doi.org/10.7717/peerj-cs.952
_version_ 1784714559083249664
author Alsubhi, Kholoud
Jamal, Amani
Alhothali, Areej
author_facet Alsubhi, Kholoud
Jamal, Amani
Alhothali, Areej
author_sort Alsubhi, Kholoud
collection PubMed
description Open-domain question answering (OpenQA) is one of the most challenging yet widely investigated problems in natural language processing. It aims at building a system that can answer any given question from large-scale unstructured text or structured knowledge-base. To solve this problem, researchers traditionally use information retrieval methods to retrieve the most relevant documents and then use answer extractions techniques to extract the answer or passage from the candidate documents. In recent years, deep learning techniques have shown great success in OpenQA by using dense representation for document retrieval and reading comprehension for answer extraction. However, despite the advancement in the English language OpenQA, other languages such as Arabic have received less attention and are often addressed using traditional methods. In this paper, we use deep learning methods for Arabic OpenQA. The model consists of document retrieval to retrieve passages relevant to a question from large-scale free text resources such as Wikipedia and an answer reader to extract the precise answer to the given question. The model implements dense passage retriever for the passage retrieval task and the AraELECTRA for the reading comprehension task. The result was compared to traditional Arabic OpenQA approaches and deep learning methods in the English OpenQA. The results show that the dense passage retriever outperforms the traditional Term Frequency-Inverse Document Frequency (TF-IDF) information retriever in terms of the top-20 passage retrieval accuracy and improves our end-to-end question answering system in two Arabic question-answering benchmark datasets.
format Online
Article
Text
id pubmed-9138168
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher PeerJ Inc.
record_format MEDLINE/PubMed
spelling pubmed-91381682022-05-28 Deep learning-based approach for Arabic open domain question answering Alsubhi, Kholoud Jamal, Amani Alhothali, Areej PeerJ Comput Sci Artificial Intelligence Open-domain question answering (OpenQA) is one of the most challenging yet widely investigated problems in natural language processing. It aims at building a system that can answer any given question from large-scale unstructured text or structured knowledge-base. To solve this problem, researchers traditionally use information retrieval methods to retrieve the most relevant documents and then use answer extractions techniques to extract the answer or passage from the candidate documents. In recent years, deep learning techniques have shown great success in OpenQA by using dense representation for document retrieval and reading comprehension for answer extraction. However, despite the advancement in the English language OpenQA, other languages such as Arabic have received less attention and are often addressed using traditional methods. In this paper, we use deep learning methods for Arabic OpenQA. The model consists of document retrieval to retrieve passages relevant to a question from large-scale free text resources such as Wikipedia and an answer reader to extract the precise answer to the given question. The model implements dense passage retriever for the passage retrieval task and the AraELECTRA for the reading comprehension task. The result was compared to traditional Arabic OpenQA approaches and deep learning methods in the English OpenQA. The results show that the dense passage retriever outperforms the traditional Term Frequency-Inverse Document Frequency (TF-IDF) information retriever in terms of the top-20 passage retrieval accuracy and improves our end-to-end question answering system in two Arabic question-answering benchmark datasets. PeerJ Inc. 2022-05-04 /pmc/articles/PMC9138168/ /pubmed/35634104 http://dx.doi.org/10.7717/peerj-cs.952 Text en © 2022 Alsubhi et al. https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, reproduction and adaptation in any medium and for any purpose provided that it is properly attributed. For attribution, the original author(s), title, publication source (PeerJ Computer Science) and either DOI or URL of the article must be cited.
spellingShingle Artificial Intelligence
Alsubhi, Kholoud
Jamal, Amani
Alhothali, Areej
Deep learning-based approach for Arabic open domain question answering
title Deep learning-based approach for Arabic open domain question answering
title_full Deep learning-based approach for Arabic open domain question answering
title_fullStr Deep learning-based approach for Arabic open domain question answering
title_full_unstemmed Deep learning-based approach for Arabic open domain question answering
title_short Deep learning-based approach for Arabic open domain question answering
title_sort deep learning-based approach for arabic open domain question answering
topic Artificial Intelligence
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9138168/
https://www.ncbi.nlm.nih.gov/pubmed/35634104
http://dx.doi.org/10.7717/peerj-cs.952
work_keys_str_mv AT alsubhikholoud deeplearningbasedapproachforarabicopendomainquestionanswering
AT jamalamani deeplearningbasedapproachforarabicopendomainquestionanswering
AT alhothaliareej deeplearningbasedapproachforarabicopendomainquestionanswering