Cargando…

Model-based test case prioritization using selective and even-spread count-based methods with scrutinized ordering criterion

Regression testing is crucial in ensuring that modifications made did not introduce any adverse effect on the software being modified. However, regression testing suffers from execution cost and time consumption problems. Test case prioritization (TCP) is one of the techniques used to overcome these...

Descripción completa

Detalles Bibliográficos
Autores principales: Mohd-Shafie, Muhammad Luqman, Wan-Kadir, Wan Mohd Nasir, Khatibsyarbini, Muhammad, Isa, Mohd Adham
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7034818/
https://www.ncbi.nlm.nih.gov/pubmed/32084232
http://dx.doi.org/10.1371/journal.pone.0229312
_version_ 1783499948354961408
author Mohd-Shafie, Muhammad Luqman
Wan-Kadir, Wan Mohd Nasir
Khatibsyarbini, Muhammad
Isa, Mohd Adham
author_facet Mohd-Shafie, Muhammad Luqman
Wan-Kadir, Wan Mohd Nasir
Khatibsyarbini, Muhammad
Isa, Mohd Adham
author_sort Mohd-Shafie, Muhammad Luqman
collection PubMed
description Regression testing is crucial in ensuring that modifications made did not introduce any adverse effect on the software being modified. However, regression testing suffers from execution cost and time consumption problems. Test case prioritization (TCP) is one of the techniques used to overcome these issues by re-ordering test cases based on their priorities. Model-based TCP (MB-TCP) is an approach in TCP where the software models are manipulated to perform prioritization. The issue with MB-TCP is that most of the existing approaches do not provide satisfactory faults detection capability. Besides, their granularity of test selection criteria is not very good and this can affect prioritization effectiveness. This study proposes an MB-TCP approach that can improve the faults detection performance of regression testing. It combines the implementation of two existing approaches from the literature while incorporating an additional ordering criterion to boost prioritization efficacy. A detailed empirical study is conducted with the aim to evaluate and compare the performance of the proposed approach with the selected existing approaches from the literature using the average of the percentage of faults detected (APFD) metric. Three web applications were used as the objects of study to obtain the required test suites that contained the tests to be prioritized. From the result obtained, the proposed approach yields the highest APFD values over other existing approaches which are 91%, 86% and 91% respectively for the three web applications. These higher APFD values signify that the proposed approach is very effective in revealing faults early during testing. They also show that the proposed approach can improve the faults detection performance of regression testing.
format Online
Article
Text
id pubmed-7034818
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-70348182020-02-27 Model-based test case prioritization using selective and even-spread count-based methods with scrutinized ordering criterion Mohd-Shafie, Muhammad Luqman Wan-Kadir, Wan Mohd Nasir Khatibsyarbini, Muhammad Isa, Mohd Adham PLoS One Research Article Regression testing is crucial in ensuring that modifications made did not introduce any adverse effect on the software being modified. However, regression testing suffers from execution cost and time consumption problems. Test case prioritization (TCP) is one of the techniques used to overcome these issues by re-ordering test cases based on their priorities. Model-based TCP (MB-TCP) is an approach in TCP where the software models are manipulated to perform prioritization. The issue with MB-TCP is that most of the existing approaches do not provide satisfactory faults detection capability. Besides, their granularity of test selection criteria is not very good and this can affect prioritization effectiveness. This study proposes an MB-TCP approach that can improve the faults detection performance of regression testing. It combines the implementation of two existing approaches from the literature while incorporating an additional ordering criterion to boost prioritization efficacy. A detailed empirical study is conducted with the aim to evaluate and compare the performance of the proposed approach with the selected existing approaches from the literature using the average of the percentage of faults detected (APFD) metric. Three web applications were used as the objects of study to obtain the required test suites that contained the tests to be prioritized. From the result obtained, the proposed approach yields the highest APFD values over other existing approaches which are 91%, 86% and 91% respectively for the three web applications. These higher APFD values signify that the proposed approach is very effective in revealing faults early during testing. They also show that the proposed approach can improve the faults detection performance of regression testing. Public Library of Science 2020-02-21 /pmc/articles/PMC7034818/ /pubmed/32084232 http://dx.doi.org/10.1371/journal.pone.0229312 Text en © 2020 Mohd-Shafie et al http://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Research Article
Mohd-Shafie, Muhammad Luqman
Wan-Kadir, Wan Mohd Nasir
Khatibsyarbini, Muhammad
Isa, Mohd Adham
Model-based test case prioritization using selective and even-spread count-based methods with scrutinized ordering criterion
title Model-based test case prioritization using selective and even-spread count-based methods with scrutinized ordering criterion
title_full Model-based test case prioritization using selective and even-spread count-based methods with scrutinized ordering criterion
title_fullStr Model-based test case prioritization using selective and even-spread count-based methods with scrutinized ordering criterion
title_full_unstemmed Model-based test case prioritization using selective and even-spread count-based methods with scrutinized ordering criterion
title_short Model-based test case prioritization using selective and even-spread count-based methods with scrutinized ordering criterion
title_sort model-based test case prioritization using selective and even-spread count-based methods with scrutinized ordering criterion
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7034818/
https://www.ncbi.nlm.nih.gov/pubmed/32084232
http://dx.doi.org/10.1371/journal.pone.0229312
work_keys_str_mv AT mohdshafiemuhammadluqman modelbasedtestcaseprioritizationusingselectiveandevenspreadcountbasedmethodswithscrutinizedorderingcriterion
AT wankadirwanmohdnasir modelbasedtestcaseprioritizationusingselectiveandevenspreadcountbasedmethodswithscrutinizedorderingcriterion
AT khatibsyarbinimuhammad modelbasedtestcaseprioritizationusingselectiveandevenspreadcountbasedmethodswithscrutinizedorderingcriterion
AT isamohdadham modelbasedtestcaseprioritizationusingselectiveandevenspreadcountbasedmethodswithscrutinizedorderingcriterion