Cargando…

Deep features optimization based on a transfer learning, genetic algorithm, and extreme learning machine for robust content-based image retrieval

The recent era has witnessed exponential growth in the production of multimedia data which initiates exploration and expansion of certain domains that will have an overwhelming impact on human society in near future. One of the domains explored in this article is content-based image retrieval (CBIR)...

Descripción completa

Detalles Bibliográficos
Autores principales: Bibi, Ruqia, Mehmood, Zahid, Munshi, Asmaa, Yousaf, Rehan Mehmood, Ahmed, Syed Sohail
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9529116/
https://www.ncbi.nlm.nih.gov/pubmed/36191011
http://dx.doi.org/10.1371/journal.pone.0274764
_version_ 1784801433958219776
author Bibi, Ruqia
Mehmood, Zahid
Munshi, Asmaa
Yousaf, Rehan Mehmood
Ahmed, Syed Sohail
author_facet Bibi, Ruqia
Mehmood, Zahid
Munshi, Asmaa
Yousaf, Rehan Mehmood
Ahmed, Syed Sohail
author_sort Bibi, Ruqia
collection PubMed
description The recent era has witnessed exponential growth in the production of multimedia data which initiates exploration and expansion of certain domains that will have an overwhelming impact on human society in near future. One of the domains explored in this article is content-based image retrieval (CBIR), in which images are mostly encoded using hand-crafted approaches that employ different descriptors and their fusions. Although utilization of these approaches has yielded outstanding results, their performance in terms of a semantic gap, computational cost, and appropriate fusion based on problem domain is still debatable. In this article, a novel CBIR method is proposed which is based on the transfer learning-based visual geometry group (VGG-19) method, genetic algorithm (GA), and extreme learning machine (ELM) classifier. In the proposed method, instead of using hand-crafted features extraction approaches, features are extracted automatically using a transfer learning-based VGG-19 model to consider both local and global information of an image for robust image retrieval. As deep features are of high dimension, the proposed method reduces the computational expense by passing the extracted features through GA which returns a reduced set of optimal features. For image classification, an extreme learning machine classifier is incorporated which is much simpler in terms of parameter tuning and learning time as compared to other traditional classifiers. The performance of the proposed method is evaluated on five datasets which highlight the better performance in terms of evaluation metrics as compared with the state-of-the-art image retrieval methods. Its statistical analysis through a nonparametric Wilcoxon matched-pairs signed-rank test also exhibits significant performance.
format Online
Article
Text
id pubmed-9529116
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-95291162022-10-04 Deep features optimization based on a transfer learning, genetic algorithm, and extreme learning machine for robust content-based image retrieval Bibi, Ruqia Mehmood, Zahid Munshi, Asmaa Yousaf, Rehan Mehmood Ahmed, Syed Sohail PLoS One Research Article The recent era has witnessed exponential growth in the production of multimedia data which initiates exploration and expansion of certain domains that will have an overwhelming impact on human society in near future. One of the domains explored in this article is content-based image retrieval (CBIR), in which images are mostly encoded using hand-crafted approaches that employ different descriptors and their fusions. Although utilization of these approaches has yielded outstanding results, their performance in terms of a semantic gap, computational cost, and appropriate fusion based on problem domain is still debatable. In this article, a novel CBIR method is proposed which is based on the transfer learning-based visual geometry group (VGG-19) method, genetic algorithm (GA), and extreme learning machine (ELM) classifier. In the proposed method, instead of using hand-crafted features extraction approaches, features are extracted automatically using a transfer learning-based VGG-19 model to consider both local and global information of an image for robust image retrieval. As deep features are of high dimension, the proposed method reduces the computational expense by passing the extracted features through GA which returns a reduced set of optimal features. For image classification, an extreme learning machine classifier is incorporated which is much simpler in terms of parameter tuning and learning time as compared to other traditional classifiers. The performance of the proposed method is evaluated on five datasets which highlight the better performance in terms of evaluation metrics as compared with the state-of-the-art image retrieval methods. Its statistical analysis through a nonparametric Wilcoxon matched-pairs signed-rank test also exhibits significant performance. Public Library of Science 2022-10-03 /pmc/articles/PMC9529116/ /pubmed/36191011 http://dx.doi.org/10.1371/journal.pone.0274764 Text en © 2022 Bibi et al https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Research Article
Bibi, Ruqia
Mehmood, Zahid
Munshi, Asmaa
Yousaf, Rehan Mehmood
Ahmed, Syed Sohail
Deep features optimization based on a transfer learning, genetic algorithm, and extreme learning machine for robust content-based image retrieval
title Deep features optimization based on a transfer learning, genetic algorithm, and extreme learning machine for robust content-based image retrieval
title_full Deep features optimization based on a transfer learning, genetic algorithm, and extreme learning machine for robust content-based image retrieval
title_fullStr Deep features optimization based on a transfer learning, genetic algorithm, and extreme learning machine for robust content-based image retrieval
title_full_unstemmed Deep features optimization based on a transfer learning, genetic algorithm, and extreme learning machine for robust content-based image retrieval
title_short Deep features optimization based on a transfer learning, genetic algorithm, and extreme learning machine for robust content-based image retrieval
title_sort deep features optimization based on a transfer learning, genetic algorithm, and extreme learning machine for robust content-based image retrieval
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9529116/
https://www.ncbi.nlm.nih.gov/pubmed/36191011
http://dx.doi.org/10.1371/journal.pone.0274764
work_keys_str_mv AT bibiruqia deepfeaturesoptimizationbasedonatransferlearninggeneticalgorithmandextremelearningmachineforrobustcontentbasedimageretrieval
AT mehmoodzahid deepfeaturesoptimizationbasedonatransferlearninggeneticalgorithmandextremelearningmachineforrobustcontentbasedimageretrieval
AT munshiasmaa deepfeaturesoptimizationbasedonatransferlearninggeneticalgorithmandextremelearningmachineforrobustcontentbasedimageretrieval
AT yousafrehanmehmood deepfeaturesoptimizationbasedonatransferlearninggeneticalgorithmandextremelearningmachineforrobustcontentbasedimageretrieval
AT ahmedsyedsohail deepfeaturesoptimizationbasedonatransferlearninggeneticalgorithmandextremelearningmachineforrobustcontentbasedimageretrieval