Cargando…
Optimizing Image Classification: Automated Deep Learning Architecture Crafting with Network and Learning Hyperparameter Tuning
This study introduces ETLBOCBL-CNN, an automated approach for optimizing convolutional neural network (CNN) architectures to address classification tasks of varying complexities. ETLBOCBL-CNN employs an effective encoding scheme to optimize network and learning hyperparameters, enabling the discover...
Autores principales: | , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10669013/ https://www.ncbi.nlm.nih.gov/pubmed/37999166 http://dx.doi.org/10.3390/biomimetics8070525 |
_version_ | 1785139595494555648 |
---|---|
author | Ang, Koon Meng Lim, Wei Hong Tiang, Sew Sun Sharma, Abhishek Eid, Marwa M. Tawfeek, Sayed M. Khafaga, Doaa Sami Alharbi, Amal H. Abdelhamid, Abdelaziz A. |
author_facet | Ang, Koon Meng Lim, Wei Hong Tiang, Sew Sun Sharma, Abhishek Eid, Marwa M. Tawfeek, Sayed M. Khafaga, Doaa Sami Alharbi, Amal H. Abdelhamid, Abdelaziz A. |
author_sort | Ang, Koon Meng |
collection | PubMed |
description | This study introduces ETLBOCBL-CNN, an automated approach for optimizing convolutional neural network (CNN) architectures to address classification tasks of varying complexities. ETLBOCBL-CNN employs an effective encoding scheme to optimize network and learning hyperparameters, enabling the discovery of innovative CNN structures. To enhance the search process, it incorporates a competency-based learning concept inspired by mixed-ability classrooms during the teacher phase. This categorizes learners into competency-based groups, guiding each learner’s search process by utilizing the knowledge of the predominant peers, the teacher solution, and the population mean. This approach fosters diversity within the population and promotes the discovery of innovative network architectures. During the learner phase, ETLBOCBL-CNN integrates a stochastic peer interaction scheme that encourages collaborative learning among learners, enhancing the optimization of CNN architectures. To preserve valuable network information and promote long-term population quality improvement, ETLBOCBL-CNN introduces a tri-criterion selection scheme that considers fitness, diversity, and learners’ improvement rates. The performance of ETLBOCBL-CNN is evaluated on nine different image datasets and compared to state-of-the-art methods. Notably, ELTLBOCBL-CNN achieves outstanding accuracies on various datasets, including MNIST (99.72%), MNIST-RD (96.67%), MNIST-RB (98.28%), MNIST-BI (97.22%), MNST-RD + BI (83.45%), Rectangles (99.99%), Rectangles-I (97.41%), Convex (98.35%), and MNIST-Fashion (93.70%). These results highlight the remarkable classification accuracy of ETLBOCBL-CNN, underscoring its potential for advancing smart device infrastructure development. |
format | Online Article Text |
id | pubmed-10669013 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-106690132023-11-04 Optimizing Image Classification: Automated Deep Learning Architecture Crafting with Network and Learning Hyperparameter Tuning Ang, Koon Meng Lim, Wei Hong Tiang, Sew Sun Sharma, Abhishek Eid, Marwa M. Tawfeek, Sayed M. Khafaga, Doaa Sami Alharbi, Amal H. Abdelhamid, Abdelaziz A. Biomimetics (Basel) Article This study introduces ETLBOCBL-CNN, an automated approach for optimizing convolutional neural network (CNN) architectures to address classification tasks of varying complexities. ETLBOCBL-CNN employs an effective encoding scheme to optimize network and learning hyperparameters, enabling the discovery of innovative CNN structures. To enhance the search process, it incorporates a competency-based learning concept inspired by mixed-ability classrooms during the teacher phase. This categorizes learners into competency-based groups, guiding each learner’s search process by utilizing the knowledge of the predominant peers, the teacher solution, and the population mean. This approach fosters diversity within the population and promotes the discovery of innovative network architectures. During the learner phase, ETLBOCBL-CNN integrates a stochastic peer interaction scheme that encourages collaborative learning among learners, enhancing the optimization of CNN architectures. To preserve valuable network information and promote long-term population quality improvement, ETLBOCBL-CNN introduces a tri-criterion selection scheme that considers fitness, diversity, and learners’ improvement rates. The performance of ETLBOCBL-CNN is evaluated on nine different image datasets and compared to state-of-the-art methods. Notably, ELTLBOCBL-CNN achieves outstanding accuracies on various datasets, including MNIST (99.72%), MNIST-RD (96.67%), MNIST-RB (98.28%), MNIST-BI (97.22%), MNST-RD + BI (83.45%), Rectangles (99.99%), Rectangles-I (97.41%), Convex (98.35%), and MNIST-Fashion (93.70%). These results highlight the remarkable classification accuracy of ETLBOCBL-CNN, underscoring its potential for advancing smart device infrastructure development. MDPI 2023-11-04 /pmc/articles/PMC10669013/ /pubmed/37999166 http://dx.doi.org/10.3390/biomimetics8070525 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Ang, Koon Meng Lim, Wei Hong Tiang, Sew Sun Sharma, Abhishek Eid, Marwa M. Tawfeek, Sayed M. Khafaga, Doaa Sami Alharbi, Amal H. Abdelhamid, Abdelaziz A. Optimizing Image Classification: Automated Deep Learning Architecture Crafting with Network and Learning Hyperparameter Tuning |
title | Optimizing Image Classification: Automated Deep Learning Architecture Crafting with Network and Learning Hyperparameter Tuning |
title_full | Optimizing Image Classification: Automated Deep Learning Architecture Crafting with Network and Learning Hyperparameter Tuning |
title_fullStr | Optimizing Image Classification: Automated Deep Learning Architecture Crafting with Network and Learning Hyperparameter Tuning |
title_full_unstemmed | Optimizing Image Classification: Automated Deep Learning Architecture Crafting with Network and Learning Hyperparameter Tuning |
title_short | Optimizing Image Classification: Automated Deep Learning Architecture Crafting with Network and Learning Hyperparameter Tuning |
title_sort | optimizing image classification: automated deep learning architecture crafting with network and learning hyperparameter tuning |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10669013/ https://www.ncbi.nlm.nih.gov/pubmed/37999166 http://dx.doi.org/10.3390/biomimetics8070525 |
work_keys_str_mv | AT angkoonmeng optimizingimageclassificationautomateddeeplearningarchitecturecraftingwithnetworkandlearninghyperparametertuning AT limweihong optimizingimageclassificationautomateddeeplearningarchitecturecraftingwithnetworkandlearninghyperparametertuning AT tiangsewsun optimizingimageclassificationautomateddeeplearningarchitecturecraftingwithnetworkandlearninghyperparametertuning AT sharmaabhishek optimizingimageclassificationautomateddeeplearningarchitecturecraftingwithnetworkandlearninghyperparametertuning AT eidmarwam optimizingimageclassificationautomateddeeplearningarchitecturecraftingwithnetworkandlearninghyperparametertuning AT tawfeeksayedm optimizingimageclassificationautomateddeeplearningarchitecturecraftingwithnetworkandlearninghyperparametertuning AT khafagadoaasami optimizingimageclassificationautomateddeeplearningarchitecturecraftingwithnetworkandlearninghyperparametertuning AT alharbiamalh optimizingimageclassificationautomateddeeplearningarchitecturecraftingwithnetworkandlearninghyperparametertuning AT abdelhamidabdelaziza optimizingimageclassificationautomateddeeplearningarchitecturecraftingwithnetworkandlearninghyperparametertuning |