Cargando…

Optimizing Image Classification: Automated Deep Learning Architecture Crafting with Network and Learning Hyperparameter Tuning

This study introduces ETLBOCBL-CNN, an automated approach for optimizing convolutional neural network (CNN) architectures to address classification tasks of varying complexities. ETLBOCBL-CNN employs an effective encoding scheme to optimize network and learning hyperparameters, enabling the discover...

Descripción completa

Detalles Bibliográficos
Autores principales: Ang, Koon Meng, Lim, Wei Hong, Tiang, Sew Sun, Sharma, Abhishek, Eid, Marwa M., Tawfeek, Sayed M., Khafaga, Doaa Sami, Alharbi, Amal H., Abdelhamid, Abdelaziz A.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10669013/
https://www.ncbi.nlm.nih.gov/pubmed/37999166
http://dx.doi.org/10.3390/biomimetics8070525
_version_ 1785139595494555648
author Ang, Koon Meng
Lim, Wei Hong
Tiang, Sew Sun
Sharma, Abhishek
Eid, Marwa M.
Tawfeek, Sayed M.
Khafaga, Doaa Sami
Alharbi, Amal H.
Abdelhamid, Abdelaziz A.
author_facet Ang, Koon Meng
Lim, Wei Hong
Tiang, Sew Sun
Sharma, Abhishek
Eid, Marwa M.
Tawfeek, Sayed M.
Khafaga, Doaa Sami
Alharbi, Amal H.
Abdelhamid, Abdelaziz A.
author_sort Ang, Koon Meng
collection PubMed
description This study introduces ETLBOCBL-CNN, an automated approach for optimizing convolutional neural network (CNN) architectures to address classification tasks of varying complexities. ETLBOCBL-CNN employs an effective encoding scheme to optimize network and learning hyperparameters, enabling the discovery of innovative CNN structures. To enhance the search process, it incorporates a competency-based learning concept inspired by mixed-ability classrooms during the teacher phase. This categorizes learners into competency-based groups, guiding each learner’s search process by utilizing the knowledge of the predominant peers, the teacher solution, and the population mean. This approach fosters diversity within the population and promotes the discovery of innovative network architectures. During the learner phase, ETLBOCBL-CNN integrates a stochastic peer interaction scheme that encourages collaborative learning among learners, enhancing the optimization of CNN architectures. To preserve valuable network information and promote long-term population quality improvement, ETLBOCBL-CNN introduces a tri-criterion selection scheme that considers fitness, diversity, and learners’ improvement rates. The performance of ETLBOCBL-CNN is evaluated on nine different image datasets and compared to state-of-the-art methods. Notably, ELTLBOCBL-CNN achieves outstanding accuracies on various datasets, including MNIST (99.72%), MNIST-RD (96.67%), MNIST-RB (98.28%), MNIST-BI (97.22%), MNST-RD + BI (83.45%), Rectangles (99.99%), Rectangles-I (97.41%), Convex (98.35%), and MNIST-Fashion (93.70%). These results highlight the remarkable classification accuracy of ETLBOCBL-CNN, underscoring its potential for advancing smart device infrastructure development.
format Online
Article
Text
id pubmed-10669013
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-106690132023-11-04 Optimizing Image Classification: Automated Deep Learning Architecture Crafting with Network and Learning Hyperparameter Tuning Ang, Koon Meng Lim, Wei Hong Tiang, Sew Sun Sharma, Abhishek Eid, Marwa M. Tawfeek, Sayed M. Khafaga, Doaa Sami Alharbi, Amal H. Abdelhamid, Abdelaziz A. Biomimetics (Basel) Article This study introduces ETLBOCBL-CNN, an automated approach for optimizing convolutional neural network (CNN) architectures to address classification tasks of varying complexities. ETLBOCBL-CNN employs an effective encoding scheme to optimize network and learning hyperparameters, enabling the discovery of innovative CNN structures. To enhance the search process, it incorporates a competency-based learning concept inspired by mixed-ability classrooms during the teacher phase. This categorizes learners into competency-based groups, guiding each learner’s search process by utilizing the knowledge of the predominant peers, the teacher solution, and the population mean. This approach fosters diversity within the population and promotes the discovery of innovative network architectures. During the learner phase, ETLBOCBL-CNN integrates a stochastic peer interaction scheme that encourages collaborative learning among learners, enhancing the optimization of CNN architectures. To preserve valuable network information and promote long-term population quality improvement, ETLBOCBL-CNN introduces a tri-criterion selection scheme that considers fitness, diversity, and learners’ improvement rates. The performance of ETLBOCBL-CNN is evaluated on nine different image datasets and compared to state-of-the-art methods. Notably, ELTLBOCBL-CNN achieves outstanding accuracies on various datasets, including MNIST (99.72%), MNIST-RD (96.67%), MNIST-RB (98.28%), MNIST-BI (97.22%), MNST-RD + BI (83.45%), Rectangles (99.99%), Rectangles-I (97.41%), Convex (98.35%), and MNIST-Fashion (93.70%). These results highlight the remarkable classification accuracy of ETLBOCBL-CNN, underscoring its potential for advancing smart device infrastructure development. MDPI 2023-11-04 /pmc/articles/PMC10669013/ /pubmed/37999166 http://dx.doi.org/10.3390/biomimetics8070525 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Ang, Koon Meng
Lim, Wei Hong
Tiang, Sew Sun
Sharma, Abhishek
Eid, Marwa M.
Tawfeek, Sayed M.
Khafaga, Doaa Sami
Alharbi, Amal H.
Abdelhamid, Abdelaziz A.
Optimizing Image Classification: Automated Deep Learning Architecture Crafting with Network and Learning Hyperparameter Tuning
title Optimizing Image Classification: Automated Deep Learning Architecture Crafting with Network and Learning Hyperparameter Tuning
title_full Optimizing Image Classification: Automated Deep Learning Architecture Crafting with Network and Learning Hyperparameter Tuning
title_fullStr Optimizing Image Classification: Automated Deep Learning Architecture Crafting with Network and Learning Hyperparameter Tuning
title_full_unstemmed Optimizing Image Classification: Automated Deep Learning Architecture Crafting with Network and Learning Hyperparameter Tuning
title_short Optimizing Image Classification: Automated Deep Learning Architecture Crafting with Network and Learning Hyperparameter Tuning
title_sort optimizing image classification: automated deep learning architecture crafting with network and learning hyperparameter tuning
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10669013/
https://www.ncbi.nlm.nih.gov/pubmed/37999166
http://dx.doi.org/10.3390/biomimetics8070525
work_keys_str_mv AT angkoonmeng optimizingimageclassificationautomateddeeplearningarchitecturecraftingwithnetworkandlearninghyperparametertuning
AT limweihong optimizingimageclassificationautomateddeeplearningarchitecturecraftingwithnetworkandlearninghyperparametertuning
AT tiangsewsun optimizingimageclassificationautomateddeeplearningarchitecturecraftingwithnetworkandlearninghyperparametertuning
AT sharmaabhishek optimizingimageclassificationautomateddeeplearningarchitecturecraftingwithnetworkandlearninghyperparametertuning
AT eidmarwam optimizingimageclassificationautomateddeeplearningarchitecturecraftingwithnetworkandlearninghyperparametertuning
AT tawfeeksayedm optimizingimageclassificationautomateddeeplearningarchitecturecraftingwithnetworkandlearninghyperparametertuning
AT khafagadoaasami optimizingimageclassificationautomateddeeplearningarchitecturecraftingwithnetworkandlearninghyperparametertuning
AT alharbiamalh optimizingimageclassificationautomateddeeplearningarchitecturecraftingwithnetworkandlearninghyperparametertuning
AT abdelhamidabdelaziza optimizingimageclassificationautomateddeeplearningarchitecturecraftingwithnetworkandlearninghyperparametertuning