Cargando…

An efficient churn prediction model using gradient boosting machine and metaheuristic optimization

Customer churn remains a critical challenge in telecommunications, necessitating effective churn prediction (CP) methodologies. This paper introduces the Enhanced Gradient Boosting Model (EGBM), which uses a Support Vector Machine with a Radial Basis Function kernel (SVM(RBF)) as a base learner and...

Descripción completa

Detalles Bibliográficos
Autores principales: AlShourbaji, Ibrahim, Helian, Na, Sun, Yi, Hussien, Abdelazim G., Abualigah, Laith, Elnaim, Bushra
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10475067/
https://www.ncbi.nlm.nih.gov/pubmed/37660198
http://dx.doi.org/10.1038/s41598-023-41093-6
_version_ 1785100639184879616
author AlShourbaji, Ibrahim
Helian, Na
Sun, Yi
Hussien, Abdelazim G.
Abualigah, Laith
Elnaim, Bushra
author_facet AlShourbaji, Ibrahim
Helian, Na
Sun, Yi
Hussien, Abdelazim G.
Abualigah, Laith
Elnaim, Bushra
author_sort AlShourbaji, Ibrahim
collection PubMed
description Customer churn remains a critical challenge in telecommunications, necessitating effective churn prediction (CP) methodologies. This paper introduces the Enhanced Gradient Boosting Model (EGBM), which uses a Support Vector Machine with a Radial Basis Function kernel (SVM(RBF)) as a base learner and exponential loss function to enhance the learning process of the GBM. The novel base learner significantly improves the initial classification performance of the traditional GBM and achieves enhanced performance in CP-EGBM after multiple boosting stages by utilizing state-of-the-art decision tree learners. Further, a modified version of Particle Swarm Optimization (PSO) using the consumption operator of the Artificial Ecosystem Optimization (AEO) method to prevent premature convergence of the PSO in the local optima is developed to tune the hyper-parameters of the CP-EGBM effectively. Seven open-source CP datasets are used to evaluate the performance of the developed CP-EGBM model using several quantitative evaluation metrics. The results showed that the CP-EGBM is significantly better than GBM and SVM models. Results are statistically validated using the Friedman ranking test. The proposed CP-EGBM is also compared with recently reported models in the literature. Comparative analysis with state-of-the-art models showcases CP-EGBM's promising improvements, making it a robust and effective solution for churn prediction in the telecommunications industry.
format Online
Article
Text
id pubmed-10475067
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-104750672023-09-04 An efficient churn prediction model using gradient boosting machine and metaheuristic optimization AlShourbaji, Ibrahim Helian, Na Sun, Yi Hussien, Abdelazim G. Abualigah, Laith Elnaim, Bushra Sci Rep Article Customer churn remains a critical challenge in telecommunications, necessitating effective churn prediction (CP) methodologies. This paper introduces the Enhanced Gradient Boosting Model (EGBM), which uses a Support Vector Machine with a Radial Basis Function kernel (SVM(RBF)) as a base learner and exponential loss function to enhance the learning process of the GBM. The novel base learner significantly improves the initial classification performance of the traditional GBM and achieves enhanced performance in CP-EGBM after multiple boosting stages by utilizing state-of-the-art decision tree learners. Further, a modified version of Particle Swarm Optimization (PSO) using the consumption operator of the Artificial Ecosystem Optimization (AEO) method to prevent premature convergence of the PSO in the local optima is developed to tune the hyper-parameters of the CP-EGBM effectively. Seven open-source CP datasets are used to evaluate the performance of the developed CP-EGBM model using several quantitative evaluation metrics. The results showed that the CP-EGBM is significantly better than GBM and SVM models. Results are statistically validated using the Friedman ranking test. The proposed CP-EGBM is also compared with recently reported models in the literature. Comparative analysis with state-of-the-art models showcases CP-EGBM's promising improvements, making it a robust and effective solution for churn prediction in the telecommunications industry. Nature Publishing Group UK 2023-09-02 /pmc/articles/PMC10475067/ /pubmed/37660198 http://dx.doi.org/10.1038/s41598-023-41093-6 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
AlShourbaji, Ibrahim
Helian, Na
Sun, Yi
Hussien, Abdelazim G.
Abualigah, Laith
Elnaim, Bushra
An efficient churn prediction model using gradient boosting machine and metaheuristic optimization
title An efficient churn prediction model using gradient boosting machine and metaheuristic optimization
title_full An efficient churn prediction model using gradient boosting machine and metaheuristic optimization
title_fullStr An efficient churn prediction model using gradient boosting machine and metaheuristic optimization
title_full_unstemmed An efficient churn prediction model using gradient boosting machine and metaheuristic optimization
title_short An efficient churn prediction model using gradient boosting machine and metaheuristic optimization
title_sort efficient churn prediction model using gradient boosting machine and metaheuristic optimization
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10475067/
https://www.ncbi.nlm.nih.gov/pubmed/37660198
http://dx.doi.org/10.1038/s41598-023-41093-6
work_keys_str_mv AT alshourbajiibrahim anefficientchurnpredictionmodelusinggradientboostingmachineandmetaheuristicoptimization
AT helianna anefficientchurnpredictionmodelusinggradientboostingmachineandmetaheuristicoptimization
AT sunyi anefficientchurnpredictionmodelusinggradientboostingmachineandmetaheuristicoptimization
AT hussienabdelazimg anefficientchurnpredictionmodelusinggradientboostingmachineandmetaheuristicoptimization
AT abualigahlaith anefficientchurnpredictionmodelusinggradientboostingmachineandmetaheuristicoptimization
AT elnaimbushra anefficientchurnpredictionmodelusinggradientboostingmachineandmetaheuristicoptimization
AT alshourbajiibrahim efficientchurnpredictionmodelusinggradientboostingmachineandmetaheuristicoptimization
AT helianna efficientchurnpredictionmodelusinggradientboostingmachineandmetaheuristicoptimization
AT sunyi efficientchurnpredictionmodelusinggradientboostingmachineandmetaheuristicoptimization
AT hussienabdelazimg efficientchurnpredictionmodelusinggradientboostingmachineandmetaheuristicoptimization
AT abualigahlaith efficientchurnpredictionmodelusinggradientboostingmachineandmetaheuristicoptimization
AT elnaimbushra efficientchurnpredictionmodelusinggradientboostingmachineandmetaheuristicoptimization