Cargando…
A Comparative Study of Deep Learning Classification Methods on a Small Environmental Microorganism Image Dataset (EMDS-6): From Convolutional Neural Networks to Visual Transformers
In recent years, deep learning has made brilliant achievements in Environmental Microorganism (EM) image classification. However, image classification of small EM datasets has still not obtained good research results. Therefore, researchers need to spend a lot of time searching for models with good...
Autores principales: | , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8924496/ https://www.ncbi.nlm.nih.gov/pubmed/35308350 http://dx.doi.org/10.3389/fmicb.2022.792166 |
_version_ | 1784669869338263552 |
---|---|
author | Zhao, Peng Li, Chen Rahaman, Md Mamunur Xu, Hao Yang, Hechen Sun, Hongzan Jiang, Tao Grzegorzek, Marcin |
author_facet | Zhao, Peng Li, Chen Rahaman, Md Mamunur Xu, Hao Yang, Hechen Sun, Hongzan Jiang, Tao Grzegorzek, Marcin |
author_sort | Zhao, Peng |
collection | PubMed |
description | In recent years, deep learning has made brilliant achievements in Environmental Microorganism (EM) image classification. However, image classification of small EM datasets has still not obtained good research results. Therefore, researchers need to spend a lot of time searching for models with good classification performance and suitable for the current equipment working environment. To provide reliable references for researchers, we conduct a series of comparison experiments on 21 deep learning models. The experiment includes direct classification, imbalanced training, and hyper-parameters tuning experiments. During the experiments, we find complementarities among the 21 models, which is the basis for feature fusion related experiments. We also find that the data augmentation method of geometric deformation is difficult to improve the performance of VTs (ViT, DeiT, BotNet, and T2T-ViT) series models. In terms of model performance, Xception has the best classification performance, the vision transformer (ViT) model consumes the least time for training, and the ShuffleNet-V2 model has the least number of parameters. |
format | Online Article Text |
id | pubmed-8924496 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-89244962022-03-17 A Comparative Study of Deep Learning Classification Methods on a Small Environmental Microorganism Image Dataset (EMDS-6): From Convolutional Neural Networks to Visual Transformers Zhao, Peng Li, Chen Rahaman, Md Mamunur Xu, Hao Yang, Hechen Sun, Hongzan Jiang, Tao Grzegorzek, Marcin Front Microbiol Microbiology In recent years, deep learning has made brilliant achievements in Environmental Microorganism (EM) image classification. However, image classification of small EM datasets has still not obtained good research results. Therefore, researchers need to spend a lot of time searching for models with good classification performance and suitable for the current equipment working environment. To provide reliable references for researchers, we conduct a series of comparison experiments on 21 deep learning models. The experiment includes direct classification, imbalanced training, and hyper-parameters tuning experiments. During the experiments, we find complementarities among the 21 models, which is the basis for feature fusion related experiments. We also find that the data augmentation method of geometric deformation is difficult to improve the performance of VTs (ViT, DeiT, BotNet, and T2T-ViT) series models. In terms of model performance, Xception has the best classification performance, the vision transformer (ViT) model consumes the least time for training, and the ShuffleNet-V2 model has the least number of parameters. Frontiers Media S.A. 2022-03-02 /pmc/articles/PMC8924496/ /pubmed/35308350 http://dx.doi.org/10.3389/fmicb.2022.792166 Text en Copyright © 2022 Zhao, Li, Rahaman, Xu, Yang, Sun, Jiang and Grzegorzek. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Microbiology Zhao, Peng Li, Chen Rahaman, Md Mamunur Xu, Hao Yang, Hechen Sun, Hongzan Jiang, Tao Grzegorzek, Marcin A Comparative Study of Deep Learning Classification Methods on a Small Environmental Microorganism Image Dataset (EMDS-6): From Convolutional Neural Networks to Visual Transformers |
title | A Comparative Study of Deep Learning Classification Methods on a Small Environmental Microorganism Image Dataset (EMDS-6): From Convolutional Neural Networks to Visual Transformers |
title_full | A Comparative Study of Deep Learning Classification Methods on a Small Environmental Microorganism Image Dataset (EMDS-6): From Convolutional Neural Networks to Visual Transformers |
title_fullStr | A Comparative Study of Deep Learning Classification Methods on a Small Environmental Microorganism Image Dataset (EMDS-6): From Convolutional Neural Networks to Visual Transformers |
title_full_unstemmed | A Comparative Study of Deep Learning Classification Methods on a Small Environmental Microorganism Image Dataset (EMDS-6): From Convolutional Neural Networks to Visual Transformers |
title_short | A Comparative Study of Deep Learning Classification Methods on a Small Environmental Microorganism Image Dataset (EMDS-6): From Convolutional Neural Networks to Visual Transformers |
title_sort | comparative study of deep learning classification methods on a small environmental microorganism image dataset (emds-6): from convolutional neural networks to visual transformers |
topic | Microbiology |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8924496/ https://www.ncbi.nlm.nih.gov/pubmed/35308350 http://dx.doi.org/10.3389/fmicb.2022.792166 |
work_keys_str_mv | AT zhaopeng acomparativestudyofdeeplearningclassificationmethodsonasmallenvironmentalmicroorganismimagedatasetemds6fromconvolutionalneuralnetworkstovisualtransformers AT lichen acomparativestudyofdeeplearningclassificationmethodsonasmallenvironmentalmicroorganismimagedatasetemds6fromconvolutionalneuralnetworkstovisualtransformers AT rahamanmdmamunur acomparativestudyofdeeplearningclassificationmethodsonasmallenvironmentalmicroorganismimagedatasetemds6fromconvolutionalneuralnetworkstovisualtransformers AT xuhao acomparativestudyofdeeplearningclassificationmethodsonasmallenvironmentalmicroorganismimagedatasetemds6fromconvolutionalneuralnetworkstovisualtransformers AT yanghechen acomparativestudyofdeeplearningclassificationmethodsonasmallenvironmentalmicroorganismimagedatasetemds6fromconvolutionalneuralnetworkstovisualtransformers AT sunhongzan acomparativestudyofdeeplearningclassificationmethodsonasmallenvironmentalmicroorganismimagedatasetemds6fromconvolutionalneuralnetworkstovisualtransformers AT jiangtao acomparativestudyofdeeplearningclassificationmethodsonasmallenvironmentalmicroorganismimagedatasetemds6fromconvolutionalneuralnetworkstovisualtransformers AT grzegorzekmarcin acomparativestudyofdeeplearningclassificationmethodsonasmallenvironmentalmicroorganismimagedatasetemds6fromconvolutionalneuralnetworkstovisualtransformers AT zhaopeng comparativestudyofdeeplearningclassificationmethodsonasmallenvironmentalmicroorganismimagedatasetemds6fromconvolutionalneuralnetworkstovisualtransformers AT lichen comparativestudyofdeeplearningclassificationmethodsonasmallenvironmentalmicroorganismimagedatasetemds6fromconvolutionalneuralnetworkstovisualtransformers AT rahamanmdmamunur comparativestudyofdeeplearningclassificationmethodsonasmallenvironmentalmicroorganismimagedatasetemds6fromconvolutionalneuralnetworkstovisualtransformers AT xuhao comparativestudyofdeeplearningclassificationmethodsonasmallenvironmentalmicroorganismimagedatasetemds6fromconvolutionalneuralnetworkstovisualtransformers AT yanghechen comparativestudyofdeeplearningclassificationmethodsonasmallenvironmentalmicroorganismimagedatasetemds6fromconvolutionalneuralnetworkstovisualtransformers AT sunhongzan comparativestudyofdeeplearningclassificationmethodsonasmallenvironmentalmicroorganismimagedatasetemds6fromconvolutionalneuralnetworkstovisualtransformers AT jiangtao comparativestudyofdeeplearningclassificationmethodsonasmallenvironmentalmicroorganismimagedatasetemds6fromconvolutionalneuralnetworkstovisualtransformers AT grzegorzekmarcin comparativestudyofdeeplearningclassificationmethodsonasmallenvironmentalmicroorganismimagedatasetemds6fromconvolutionalneuralnetworkstovisualtransformers |