Cargando…

Nature inspired optimization tools for SVMs - NIOTS

Support Vector Machines (SVMs) technique for achieving classifiers and regressors. However, to obtain models with high accuracy and low complexity, it is necessary to define the kernel parameters as well as the parameters of the training model, which are called hyperparameters. The challenge of defi...

Descripción completa

Detalles Bibliográficos
Autores principales: Santos, Carlos Eduardo da Silva, Coelho, Leandro dos Santos, Llanos, Carlos Humberto
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Elsevier 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8720899/
https://www.ncbi.nlm.nih.gov/pubmed/35004208
http://dx.doi.org/10.1016/j.mex.2021.101574
_version_ 1784625224338112512
author Santos, Carlos Eduardo da Silva
Coelho, Leandro dos Santos
Llanos, Carlos Humberto
author_facet Santos, Carlos Eduardo da Silva
Coelho, Leandro dos Santos
Llanos, Carlos Humberto
author_sort Santos, Carlos Eduardo da Silva
collection PubMed
description Support Vector Machines (SVMs) technique for achieving classifiers and regressors. However, to obtain models with high accuracy and low complexity, it is necessary to define the kernel parameters as well as the parameters of the training model, which are called hyperparameters. The challenge of defining the more suitable value to hyperparameters is called the Parameter Selection Problem (PSP). However, minimizing the complexity and maximizing the generalization capacity of the SVMs are conflicting criteria. Therefore, we propose the Nature Inspired Optimization Tools for SVMs (NIOTS) that offers a method to automate the search process for the best possible solution for the PSP, allowing the user to quickly obtain several sets of good solutions and choose the one most appropriate for his specific problem. • The PSP has been modeled as a Multiobjective Optimization Problem (MOP) with two objectives: (1) good precision and (2) low complexity (low number of support vectors). • The user can evaluate multiple solutions included in the Pareto front, in terms of precision and low complexity of the model. • Apart from the Adaptive Parameter with Mutant Tournament Multiobjective Differential Evolution (APMT-MODE), the user can choose other metaheuristics and also among several kernel options.
format Online
Article
Text
id pubmed-8720899
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Elsevier
record_format MEDLINE/PubMed
spelling pubmed-87208992022-01-07 Nature inspired optimization tools for SVMs - NIOTS Santos, Carlos Eduardo da Silva Coelho, Leandro dos Santos Llanos, Carlos Humberto MethodsX Method Article Support Vector Machines (SVMs) technique for achieving classifiers and regressors. However, to obtain models with high accuracy and low complexity, it is necessary to define the kernel parameters as well as the parameters of the training model, which are called hyperparameters. The challenge of defining the more suitable value to hyperparameters is called the Parameter Selection Problem (PSP). However, minimizing the complexity and maximizing the generalization capacity of the SVMs are conflicting criteria. Therefore, we propose the Nature Inspired Optimization Tools for SVMs (NIOTS) that offers a method to automate the search process for the best possible solution for the PSP, allowing the user to quickly obtain several sets of good solutions and choose the one most appropriate for his specific problem. • The PSP has been modeled as a Multiobjective Optimization Problem (MOP) with two objectives: (1) good precision and (2) low complexity (low number of support vectors). • The user can evaluate multiple solutions included in the Pareto front, in terms of precision and low complexity of the model. • Apart from the Adaptive Parameter with Mutant Tournament Multiobjective Differential Evolution (APMT-MODE), the user can choose other metaheuristics and also among several kernel options. Elsevier 2021-11-02 /pmc/articles/PMC8720899/ /pubmed/35004208 http://dx.doi.org/10.1016/j.mex.2021.101574 Text en © 2021 The Authors. Published by Elsevier B.V. https://creativecommons.org/licenses/by/4.0/This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Method Article
Santos, Carlos Eduardo da Silva
Coelho, Leandro dos Santos
Llanos, Carlos Humberto
Nature inspired optimization tools for SVMs - NIOTS
title Nature inspired optimization tools for SVMs - NIOTS
title_full Nature inspired optimization tools for SVMs - NIOTS
title_fullStr Nature inspired optimization tools for SVMs - NIOTS
title_full_unstemmed Nature inspired optimization tools for SVMs - NIOTS
title_short Nature inspired optimization tools for SVMs - NIOTS
title_sort nature inspired optimization tools for svms - niots
topic Method Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8720899/
https://www.ncbi.nlm.nih.gov/pubmed/35004208
http://dx.doi.org/10.1016/j.mex.2021.101574
work_keys_str_mv AT santoscarloseduardodasilva natureinspiredoptimizationtoolsforsvmsniots
AT coelholeandrodossantos natureinspiredoptimizationtoolsforsvmsniots
AT llanoscarloshumberto natureinspiredoptimizationtoolsforsvmsniots