Cargando…

A Comparative Study of Deep Learning Classification Methods on a Small Environmental Microorganism Image Dataset (EMDS-6): From Convolutional Neural Networks to Visual Transformers

In recent years, deep learning has made brilliant achievements in Environmental Microorganism (EM) image classification. However, image classification of small EM datasets has still not obtained good research results. Therefore, researchers need to spend a lot of time searching for models with good...

Descripción completa

Detalles Bibliográficos
Autores principales: Zhao, Peng, Li, Chen, Rahaman, Md Mamunur, Xu, Hao, Yang, Hechen, Sun, Hongzan, Jiang, Tao, Grzegorzek, Marcin
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8924496/
https://www.ncbi.nlm.nih.gov/pubmed/35308350
http://dx.doi.org/10.3389/fmicb.2022.792166
_version_ 1784669869338263552
author Zhao, Peng
Li, Chen
Rahaman, Md Mamunur
Xu, Hao
Yang, Hechen
Sun, Hongzan
Jiang, Tao
Grzegorzek, Marcin
author_facet Zhao, Peng
Li, Chen
Rahaman, Md Mamunur
Xu, Hao
Yang, Hechen
Sun, Hongzan
Jiang, Tao
Grzegorzek, Marcin
author_sort Zhao, Peng
collection PubMed
description In recent years, deep learning has made brilliant achievements in Environmental Microorganism (EM) image classification. However, image classification of small EM datasets has still not obtained good research results. Therefore, researchers need to spend a lot of time searching for models with good classification performance and suitable for the current equipment working environment. To provide reliable references for researchers, we conduct a series of comparison experiments on 21 deep learning models. The experiment includes direct classification, imbalanced training, and hyper-parameters tuning experiments. During the experiments, we find complementarities among the 21 models, which is the basis for feature fusion related experiments. We also find that the data augmentation method of geometric deformation is difficult to improve the performance of VTs (ViT, DeiT, BotNet, and T2T-ViT) series models. In terms of model performance, Xception has the best classification performance, the vision transformer (ViT) model consumes the least time for training, and the ShuffleNet-V2 model has the least number of parameters.
format Online
Article
Text
id pubmed-8924496
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-89244962022-03-17 A Comparative Study of Deep Learning Classification Methods on a Small Environmental Microorganism Image Dataset (EMDS-6): From Convolutional Neural Networks to Visual Transformers Zhao, Peng Li, Chen Rahaman, Md Mamunur Xu, Hao Yang, Hechen Sun, Hongzan Jiang, Tao Grzegorzek, Marcin Front Microbiol Microbiology In recent years, deep learning has made brilliant achievements in Environmental Microorganism (EM) image classification. However, image classification of small EM datasets has still not obtained good research results. Therefore, researchers need to spend a lot of time searching for models with good classification performance and suitable for the current equipment working environment. To provide reliable references for researchers, we conduct a series of comparison experiments on 21 deep learning models. The experiment includes direct classification, imbalanced training, and hyper-parameters tuning experiments. During the experiments, we find complementarities among the 21 models, which is the basis for feature fusion related experiments. We also find that the data augmentation method of geometric deformation is difficult to improve the performance of VTs (ViT, DeiT, BotNet, and T2T-ViT) series models. In terms of model performance, Xception has the best classification performance, the vision transformer (ViT) model consumes the least time for training, and the ShuffleNet-V2 model has the least number of parameters. Frontiers Media S.A. 2022-03-02 /pmc/articles/PMC8924496/ /pubmed/35308350 http://dx.doi.org/10.3389/fmicb.2022.792166 Text en Copyright © 2022 Zhao, Li, Rahaman, Xu, Yang, Sun, Jiang and Grzegorzek. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Microbiology
Zhao, Peng
Li, Chen
Rahaman, Md Mamunur
Xu, Hao
Yang, Hechen
Sun, Hongzan
Jiang, Tao
Grzegorzek, Marcin
A Comparative Study of Deep Learning Classification Methods on a Small Environmental Microorganism Image Dataset (EMDS-6): From Convolutional Neural Networks to Visual Transformers
title A Comparative Study of Deep Learning Classification Methods on a Small Environmental Microorganism Image Dataset (EMDS-6): From Convolutional Neural Networks to Visual Transformers
title_full A Comparative Study of Deep Learning Classification Methods on a Small Environmental Microorganism Image Dataset (EMDS-6): From Convolutional Neural Networks to Visual Transformers
title_fullStr A Comparative Study of Deep Learning Classification Methods on a Small Environmental Microorganism Image Dataset (EMDS-6): From Convolutional Neural Networks to Visual Transformers
title_full_unstemmed A Comparative Study of Deep Learning Classification Methods on a Small Environmental Microorganism Image Dataset (EMDS-6): From Convolutional Neural Networks to Visual Transformers
title_short A Comparative Study of Deep Learning Classification Methods on a Small Environmental Microorganism Image Dataset (EMDS-6): From Convolutional Neural Networks to Visual Transformers
title_sort comparative study of deep learning classification methods on a small environmental microorganism image dataset (emds-6): from convolutional neural networks to visual transformers
topic Microbiology
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8924496/
https://www.ncbi.nlm.nih.gov/pubmed/35308350
http://dx.doi.org/10.3389/fmicb.2022.792166
work_keys_str_mv AT zhaopeng acomparativestudyofdeeplearningclassificationmethodsonasmallenvironmentalmicroorganismimagedatasetemds6fromconvolutionalneuralnetworkstovisualtransformers
AT lichen acomparativestudyofdeeplearningclassificationmethodsonasmallenvironmentalmicroorganismimagedatasetemds6fromconvolutionalneuralnetworkstovisualtransformers
AT rahamanmdmamunur acomparativestudyofdeeplearningclassificationmethodsonasmallenvironmentalmicroorganismimagedatasetemds6fromconvolutionalneuralnetworkstovisualtransformers
AT xuhao acomparativestudyofdeeplearningclassificationmethodsonasmallenvironmentalmicroorganismimagedatasetemds6fromconvolutionalneuralnetworkstovisualtransformers
AT yanghechen acomparativestudyofdeeplearningclassificationmethodsonasmallenvironmentalmicroorganismimagedatasetemds6fromconvolutionalneuralnetworkstovisualtransformers
AT sunhongzan acomparativestudyofdeeplearningclassificationmethodsonasmallenvironmentalmicroorganismimagedatasetemds6fromconvolutionalneuralnetworkstovisualtransformers
AT jiangtao acomparativestudyofdeeplearningclassificationmethodsonasmallenvironmentalmicroorganismimagedatasetemds6fromconvolutionalneuralnetworkstovisualtransformers
AT grzegorzekmarcin acomparativestudyofdeeplearningclassificationmethodsonasmallenvironmentalmicroorganismimagedatasetemds6fromconvolutionalneuralnetworkstovisualtransformers
AT zhaopeng comparativestudyofdeeplearningclassificationmethodsonasmallenvironmentalmicroorganismimagedatasetemds6fromconvolutionalneuralnetworkstovisualtransformers
AT lichen comparativestudyofdeeplearningclassificationmethodsonasmallenvironmentalmicroorganismimagedatasetemds6fromconvolutionalneuralnetworkstovisualtransformers
AT rahamanmdmamunur comparativestudyofdeeplearningclassificationmethodsonasmallenvironmentalmicroorganismimagedatasetemds6fromconvolutionalneuralnetworkstovisualtransformers
AT xuhao comparativestudyofdeeplearningclassificationmethodsonasmallenvironmentalmicroorganismimagedatasetemds6fromconvolutionalneuralnetworkstovisualtransformers
AT yanghechen comparativestudyofdeeplearningclassificationmethodsonasmallenvironmentalmicroorganismimagedatasetemds6fromconvolutionalneuralnetworkstovisualtransformers
AT sunhongzan comparativestudyofdeeplearningclassificationmethodsonasmallenvironmentalmicroorganismimagedatasetemds6fromconvolutionalneuralnetworkstovisualtransformers
AT jiangtao comparativestudyofdeeplearningclassificationmethodsonasmallenvironmentalmicroorganismimagedatasetemds6fromconvolutionalneuralnetworkstovisualtransformers
AT grzegorzekmarcin comparativestudyofdeeplearningclassificationmethodsonasmallenvironmentalmicroorganismimagedatasetemds6fromconvolutionalneuralnetworkstovisualtransformers