Cargando…
Improved barnacles mating optimizer algorithm for feature selection and support vector machine optimization
With the rapid development of computer technology, data collection becomes easier, and data object presents more complex. Data analysis method based on machine learning is an important, active, and multi-disciplinarily research field. Support vector machine (SVM) is one of the most powerful and fast...
Autores principales: | , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Springer London
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8116444/ https://www.ncbi.nlm.nih.gov/pubmed/34002110 http://dx.doi.org/10.1007/s10044-021-00985-x |
_version_ | 1783691396646961152 |
---|---|
author | Jia, Heming Sun, Kangjian |
author_facet | Jia, Heming Sun, Kangjian |
author_sort | Jia, Heming |
collection | PubMed |
description | With the rapid development of computer technology, data collection becomes easier, and data object presents more complex. Data analysis method based on machine learning is an important, active, and multi-disciplinarily research field. Support vector machine (SVM) is one of the most powerful and fast classification models. The main challenges SVM faces are the selection of feature subset and the setting of kernel parameters. To improve the performance of SVM, a metaheuristic algorithm is used to optimize them simultaneously. This paper first proposes a novel classification model called IBMO-SVM, which hybridizes an improved barnacle mating optimizer (IBMO) with SVM. Three strategies, including Gaussian mutation, logistic model, and refraction-learning, are used to improve the performance of BMO from different perspectives. Through 23 classical benchmark functions, the impact of control parameters and the effectiveness of introduced strategies are analyzed. The convergence accuracy and stability are the main gains, and exploration and exploitation phases are more properly balanced. We apply IBMO-SVM to 20 real-world datasets, including 4 extremely high-dimensional datasets. Experimental results are compared with 6 state-of-the-art methods in the literature. The final statistical results show that the proposed IBMO-SVM achieves a better performance than the standard BMO-SVM and other compared methods, especially on high-dimensional datasets. In addition, the proposed model also shows significant superiority compared with 4 other classifiers. |
format | Online Article Text |
id | pubmed-8116444 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | Springer London |
record_format | MEDLINE/PubMed |
spelling | pubmed-81164442021-05-13 Improved barnacles mating optimizer algorithm for feature selection and support vector machine optimization Jia, Heming Sun, Kangjian Pattern Anal Appl Theoretical Advances With the rapid development of computer technology, data collection becomes easier, and data object presents more complex. Data analysis method based on machine learning is an important, active, and multi-disciplinarily research field. Support vector machine (SVM) is one of the most powerful and fast classification models. The main challenges SVM faces are the selection of feature subset and the setting of kernel parameters. To improve the performance of SVM, a metaheuristic algorithm is used to optimize them simultaneously. This paper first proposes a novel classification model called IBMO-SVM, which hybridizes an improved barnacle mating optimizer (IBMO) with SVM. Three strategies, including Gaussian mutation, logistic model, and refraction-learning, are used to improve the performance of BMO from different perspectives. Through 23 classical benchmark functions, the impact of control parameters and the effectiveness of introduced strategies are analyzed. The convergence accuracy and stability are the main gains, and exploration and exploitation phases are more properly balanced. We apply IBMO-SVM to 20 real-world datasets, including 4 extremely high-dimensional datasets. Experimental results are compared with 6 state-of-the-art methods in the literature. The final statistical results show that the proposed IBMO-SVM achieves a better performance than the standard BMO-SVM and other compared methods, especially on high-dimensional datasets. In addition, the proposed model also shows significant superiority compared with 4 other classifiers. Springer London 2021-05-13 2021 /pmc/articles/PMC8116444/ /pubmed/34002110 http://dx.doi.org/10.1007/s10044-021-00985-x Text en © The Author(s), under exclusive licence to Springer-Verlag London Ltd., part of Springer Nature 2021 This article is made available via the PMC Open Access Subset for unrestricted research re-use and secondary analysis in any form or by any means with acknowledgement of the original source. These permissions are granted for the duration of the World Health Organization (WHO) declaration of COVID-19 as a global pandemic. |
spellingShingle | Theoretical Advances Jia, Heming Sun, Kangjian Improved barnacles mating optimizer algorithm for feature selection and support vector machine optimization |
title | Improved barnacles mating optimizer algorithm for feature selection and support vector machine optimization |
title_full | Improved barnacles mating optimizer algorithm for feature selection and support vector machine optimization |
title_fullStr | Improved barnacles mating optimizer algorithm for feature selection and support vector machine optimization |
title_full_unstemmed | Improved barnacles mating optimizer algorithm for feature selection and support vector machine optimization |
title_short | Improved barnacles mating optimizer algorithm for feature selection and support vector machine optimization |
title_sort | improved barnacles mating optimizer algorithm for feature selection and support vector machine optimization |
topic | Theoretical Advances |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8116444/ https://www.ncbi.nlm.nih.gov/pubmed/34002110 http://dx.doi.org/10.1007/s10044-021-00985-x |
work_keys_str_mv | AT jiaheming improvedbarnaclesmatingoptimizeralgorithmforfeatureselectionandsupportvectormachineoptimization AT sunkangjian improvedbarnaclesmatingoptimizeralgorithmforfeatureselectionandsupportvectormachineoptimization |