Cargando…
Deep learning-based approach for Arabic open domain question answering
Open-domain question answering (OpenQA) is one of the most challenging yet widely investigated problems in natural language processing. It aims at building a system that can answer any given question from large-scale unstructured text or structured knowledge-base. To solve this problem, researchers...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
PeerJ Inc.
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9138168/ https://www.ncbi.nlm.nih.gov/pubmed/35634104 http://dx.doi.org/10.7717/peerj-cs.952 |
_version_ | 1784714559083249664 |
---|---|
author | Alsubhi, Kholoud Jamal, Amani Alhothali, Areej |
author_facet | Alsubhi, Kholoud Jamal, Amani Alhothali, Areej |
author_sort | Alsubhi, Kholoud |
collection | PubMed |
description | Open-domain question answering (OpenQA) is one of the most challenging yet widely investigated problems in natural language processing. It aims at building a system that can answer any given question from large-scale unstructured text or structured knowledge-base. To solve this problem, researchers traditionally use information retrieval methods to retrieve the most relevant documents and then use answer extractions techniques to extract the answer or passage from the candidate documents. In recent years, deep learning techniques have shown great success in OpenQA by using dense representation for document retrieval and reading comprehension for answer extraction. However, despite the advancement in the English language OpenQA, other languages such as Arabic have received less attention and are often addressed using traditional methods. In this paper, we use deep learning methods for Arabic OpenQA. The model consists of document retrieval to retrieve passages relevant to a question from large-scale free text resources such as Wikipedia and an answer reader to extract the precise answer to the given question. The model implements dense passage retriever for the passage retrieval task and the AraELECTRA for the reading comprehension task. The result was compared to traditional Arabic OpenQA approaches and deep learning methods in the English OpenQA. The results show that the dense passage retriever outperforms the traditional Term Frequency-Inverse Document Frequency (TF-IDF) information retriever in terms of the top-20 passage retrieval accuracy and improves our end-to-end question answering system in two Arabic question-answering benchmark datasets. |
format | Online Article Text |
id | pubmed-9138168 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | PeerJ Inc. |
record_format | MEDLINE/PubMed |
spelling | pubmed-91381682022-05-28 Deep learning-based approach for Arabic open domain question answering Alsubhi, Kholoud Jamal, Amani Alhothali, Areej PeerJ Comput Sci Artificial Intelligence Open-domain question answering (OpenQA) is one of the most challenging yet widely investigated problems in natural language processing. It aims at building a system that can answer any given question from large-scale unstructured text or structured knowledge-base. To solve this problem, researchers traditionally use information retrieval methods to retrieve the most relevant documents and then use answer extractions techniques to extract the answer or passage from the candidate documents. In recent years, deep learning techniques have shown great success in OpenQA by using dense representation for document retrieval and reading comprehension for answer extraction. However, despite the advancement in the English language OpenQA, other languages such as Arabic have received less attention and are often addressed using traditional methods. In this paper, we use deep learning methods for Arabic OpenQA. The model consists of document retrieval to retrieve passages relevant to a question from large-scale free text resources such as Wikipedia and an answer reader to extract the precise answer to the given question. The model implements dense passage retriever for the passage retrieval task and the AraELECTRA for the reading comprehension task. The result was compared to traditional Arabic OpenQA approaches and deep learning methods in the English OpenQA. The results show that the dense passage retriever outperforms the traditional Term Frequency-Inverse Document Frequency (TF-IDF) information retriever in terms of the top-20 passage retrieval accuracy and improves our end-to-end question answering system in two Arabic question-answering benchmark datasets. PeerJ Inc. 2022-05-04 /pmc/articles/PMC9138168/ /pubmed/35634104 http://dx.doi.org/10.7717/peerj-cs.952 Text en © 2022 Alsubhi et al. https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, reproduction and adaptation in any medium and for any purpose provided that it is properly attributed. For attribution, the original author(s), title, publication source (PeerJ Computer Science) and either DOI or URL of the article must be cited. |
spellingShingle | Artificial Intelligence Alsubhi, Kholoud Jamal, Amani Alhothali, Areej Deep learning-based approach for Arabic open domain question answering |
title | Deep learning-based approach for Arabic open domain question answering |
title_full | Deep learning-based approach for Arabic open domain question answering |
title_fullStr | Deep learning-based approach for Arabic open domain question answering |
title_full_unstemmed | Deep learning-based approach for Arabic open domain question answering |
title_short | Deep learning-based approach for Arabic open domain question answering |
title_sort | deep learning-based approach for arabic open domain question answering |
topic | Artificial Intelligence |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9138168/ https://www.ncbi.nlm.nih.gov/pubmed/35634104 http://dx.doi.org/10.7717/peerj-cs.952 |
work_keys_str_mv | AT alsubhikholoud deeplearningbasedapproachforarabicopendomainquestionanswering AT jamalamani deeplearningbasedapproachforarabicopendomainquestionanswering AT alhothaliareej deeplearningbasedapproachforarabicopendomainquestionanswering |