Cargando…

Automatic grading for Arabic short answer questions using optimized deep learning model

Auto-grading of short answer questions is considered a challenging problem in the processing of natural language. It requires a system to comprehend the free text answers to automatically assign a grade for a student answer compared to one or more model answers. This paper suggests an optimized deep...

Descripción completa

Detalles Bibliográficos
Autores principales: Abdul Salam, Mustafa, El-Fatah, Mohamed Abd, Hassan, Naglaa Fathy
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9345368/
https://www.ncbi.nlm.nih.gov/pubmed/35917309
http://dx.doi.org/10.1371/journal.pone.0272269
_version_ 1784761417866412032
author Abdul Salam, Mustafa
El-Fatah, Mohamed Abd
Hassan, Naglaa Fathy
author_facet Abdul Salam, Mustafa
El-Fatah, Mohamed Abd
Hassan, Naglaa Fathy
author_sort Abdul Salam, Mustafa
collection PubMed
description Auto-grading of short answer questions is considered a challenging problem in the processing of natural language. It requires a system to comprehend the free text answers to automatically assign a grade for a student answer compared to one or more model answers. This paper suggests an optimized deep learning model for grading short-answer questions automatically by using various sizes of datasets collected in the Science subject for students in seventh grade in Egypt. The proposed system is a hybrid approach that optimizes a deep learning technique called LSTM (Long Short Term Memory) with a recent optimization algorithm called a Grey Wolf Optimizer (GWO). The GWO is employed to optimize the LSTM by selecting the best dropout and recurrent dropout rates of LSTM hyperparameters rather than manual choice. Using GWO makes the LSTM model more generalized and can also avoid the problem of overfitting in forecasting the students’ scores to improve the learning process and save instructors’ time and effort. The model’s performance is measured in terms of the Root Mean Squared Error (RMSE), the Pearson correlation coefficient, and R-Square. According to the simulation results, the hybrid GWO with the LSTM model ensured the best performance and outperformed the classical LSTM model and other compared models such that it had the highest Pearson correlation coefficient value, the lowest RMSE value, and the best R square value in all experiments, but higher training time than the traditional deep learning model.
format Online
Article
Text
id pubmed-9345368
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-93453682022-08-03 Automatic grading for Arabic short answer questions using optimized deep learning model Abdul Salam, Mustafa El-Fatah, Mohamed Abd Hassan, Naglaa Fathy PLoS One Research Article Auto-grading of short answer questions is considered a challenging problem in the processing of natural language. It requires a system to comprehend the free text answers to automatically assign a grade for a student answer compared to one or more model answers. This paper suggests an optimized deep learning model for grading short-answer questions automatically by using various sizes of datasets collected in the Science subject for students in seventh grade in Egypt. The proposed system is a hybrid approach that optimizes a deep learning technique called LSTM (Long Short Term Memory) with a recent optimization algorithm called a Grey Wolf Optimizer (GWO). The GWO is employed to optimize the LSTM by selecting the best dropout and recurrent dropout rates of LSTM hyperparameters rather than manual choice. Using GWO makes the LSTM model more generalized and can also avoid the problem of overfitting in forecasting the students’ scores to improve the learning process and save instructors’ time and effort. The model’s performance is measured in terms of the Root Mean Squared Error (RMSE), the Pearson correlation coefficient, and R-Square. According to the simulation results, the hybrid GWO with the LSTM model ensured the best performance and outperformed the classical LSTM model and other compared models such that it had the highest Pearson correlation coefficient value, the lowest RMSE value, and the best R square value in all experiments, but higher training time than the traditional deep learning model. Public Library of Science 2022-08-02 /pmc/articles/PMC9345368/ /pubmed/35917309 http://dx.doi.org/10.1371/journal.pone.0272269 Text en © 2022 Abdul Salam et al https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Research Article
Abdul Salam, Mustafa
El-Fatah, Mohamed Abd
Hassan, Naglaa Fathy
Automatic grading for Arabic short answer questions using optimized deep learning model
title Automatic grading for Arabic short answer questions using optimized deep learning model
title_full Automatic grading for Arabic short answer questions using optimized deep learning model
title_fullStr Automatic grading for Arabic short answer questions using optimized deep learning model
title_full_unstemmed Automatic grading for Arabic short answer questions using optimized deep learning model
title_short Automatic grading for Arabic short answer questions using optimized deep learning model
title_sort automatic grading for arabic short answer questions using optimized deep learning model
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9345368/
https://www.ncbi.nlm.nih.gov/pubmed/35917309
http://dx.doi.org/10.1371/journal.pone.0272269
work_keys_str_mv AT abdulsalammustafa automaticgradingforarabicshortanswerquestionsusingoptimizeddeeplearningmodel
AT elfatahmohamedabd automaticgradingforarabicshortanswerquestionsusingoptimizeddeeplearningmodel
AT hassannaglaafathy automaticgradingforarabicshortanswerquestionsusingoptimizeddeeplearningmodel