Cargando…
Nature inspired optimization tools for SVMs - NIOTS
Support Vector Machines (SVMs) technique for achieving classifiers and regressors. However, to obtain models with high accuracy and low complexity, it is necessary to define the kernel parameters as well as the parameters of the training model, which are called hyperparameters. The challenge of defi...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Elsevier
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8720899/ https://www.ncbi.nlm.nih.gov/pubmed/35004208 http://dx.doi.org/10.1016/j.mex.2021.101574 |
_version_ | 1784625224338112512 |
---|---|
author | Santos, Carlos Eduardo da Silva Coelho, Leandro dos Santos Llanos, Carlos Humberto |
author_facet | Santos, Carlos Eduardo da Silva Coelho, Leandro dos Santos Llanos, Carlos Humberto |
author_sort | Santos, Carlos Eduardo da Silva |
collection | PubMed |
description | Support Vector Machines (SVMs) technique for achieving classifiers and regressors. However, to obtain models with high accuracy and low complexity, it is necessary to define the kernel parameters as well as the parameters of the training model, which are called hyperparameters. The challenge of defining the more suitable value to hyperparameters is called the Parameter Selection Problem (PSP). However, minimizing the complexity and maximizing the generalization capacity of the SVMs are conflicting criteria. Therefore, we propose the Nature Inspired Optimization Tools for SVMs (NIOTS) that offers a method to automate the search process for the best possible solution for the PSP, allowing the user to quickly obtain several sets of good solutions and choose the one most appropriate for his specific problem. • The PSP has been modeled as a Multiobjective Optimization Problem (MOP) with two objectives: (1) good precision and (2) low complexity (low number of support vectors). • The user can evaluate multiple solutions included in the Pareto front, in terms of precision and low complexity of the model. • Apart from the Adaptive Parameter with Mutant Tournament Multiobjective Differential Evolution (APMT-MODE), the user can choose other metaheuristics and also among several kernel options. |
format | Online Article Text |
id | pubmed-8720899 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | Elsevier |
record_format | MEDLINE/PubMed |
spelling | pubmed-87208992022-01-07 Nature inspired optimization tools for SVMs - NIOTS Santos, Carlos Eduardo da Silva Coelho, Leandro dos Santos Llanos, Carlos Humberto MethodsX Method Article Support Vector Machines (SVMs) technique for achieving classifiers and regressors. However, to obtain models with high accuracy and low complexity, it is necessary to define the kernel parameters as well as the parameters of the training model, which are called hyperparameters. The challenge of defining the more suitable value to hyperparameters is called the Parameter Selection Problem (PSP). However, minimizing the complexity and maximizing the generalization capacity of the SVMs are conflicting criteria. Therefore, we propose the Nature Inspired Optimization Tools for SVMs (NIOTS) that offers a method to automate the search process for the best possible solution for the PSP, allowing the user to quickly obtain several sets of good solutions and choose the one most appropriate for his specific problem. • The PSP has been modeled as a Multiobjective Optimization Problem (MOP) with two objectives: (1) good precision and (2) low complexity (low number of support vectors). • The user can evaluate multiple solutions included in the Pareto front, in terms of precision and low complexity of the model. • Apart from the Adaptive Parameter with Mutant Tournament Multiobjective Differential Evolution (APMT-MODE), the user can choose other metaheuristics and also among several kernel options. Elsevier 2021-11-02 /pmc/articles/PMC8720899/ /pubmed/35004208 http://dx.doi.org/10.1016/j.mex.2021.101574 Text en © 2021 The Authors. Published by Elsevier B.V. https://creativecommons.org/licenses/by/4.0/This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Method Article Santos, Carlos Eduardo da Silva Coelho, Leandro dos Santos Llanos, Carlos Humberto Nature inspired optimization tools for SVMs - NIOTS |
title | Nature inspired optimization tools for SVMs - NIOTS |
title_full | Nature inspired optimization tools for SVMs - NIOTS |
title_fullStr | Nature inspired optimization tools for SVMs - NIOTS |
title_full_unstemmed | Nature inspired optimization tools for SVMs - NIOTS |
title_short | Nature inspired optimization tools for SVMs - NIOTS |
title_sort | nature inspired optimization tools for svms - niots |
topic | Method Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8720899/ https://www.ncbi.nlm.nih.gov/pubmed/35004208 http://dx.doi.org/10.1016/j.mex.2021.101574 |
work_keys_str_mv | AT santoscarloseduardodasilva natureinspiredoptimizationtoolsforsvmsniots AT coelholeandrodossantos natureinspiredoptimizationtoolsforsvmsniots AT llanoscarloshumberto natureinspiredoptimizationtoolsforsvmsniots |