Cargando…

Learning with few samples in deep learning for image classification, a mini-review

Deep learning has achieved enormous success in various computer tasks. The excellent performance depends heavily on adequate training datasets, however, it is difficult to obtain abundant samples in practical applications. Few-shot learning is proposed to address the data limitation problem in the t...

Descripción completa

Detalles Bibliográficos
Autores principales: Zhang, Rujun, Liu, Qifan
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9849670/
https://www.ncbi.nlm.nih.gov/pubmed/36686199
http://dx.doi.org/10.3389/fncom.2022.1075294
_version_ 1784872000807763968
author Zhang, Rujun
Liu, Qifan
author_facet Zhang, Rujun
Liu, Qifan
author_sort Zhang, Rujun
collection PubMed
description Deep learning has achieved enormous success in various computer tasks. The excellent performance depends heavily on adequate training datasets, however, it is difficult to obtain abundant samples in practical applications. Few-shot learning is proposed to address the data limitation problem in the training process, which can perform rapid learning with few samples by utilizing prior knowledge. In this paper, we focus on few-shot classification to conduct a survey about the recent methods. First, we elaborate on the definition of the few-shot classification problem. Then we propose a newly organized taxonomy, discuss the application scenarios in which each method is effective, and compare the pros and cons of different methods. We classify few-shot image classification methods from four perspectives: (i) Data augmentation, which contains sample-level and task-level data augmentation. (ii) Metric-based method, which analyzes both feature embedding and metric function. (iii) Optimization method, which is compared from the aspects of self-learning and mutual learning. (iv) Model-based method, which is discussed from the perspectives of memory-based, rapid adaptation and multi-task learning. Finally, we conduct the conclusion and prospect of this paper.
format Online
Article
Text
id pubmed-9849670
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-98496702023-01-20 Learning with few samples in deep learning for image classification, a mini-review Zhang, Rujun Liu, Qifan Front Comput Neurosci Neuroscience Deep learning has achieved enormous success in various computer tasks. The excellent performance depends heavily on adequate training datasets, however, it is difficult to obtain abundant samples in practical applications. Few-shot learning is proposed to address the data limitation problem in the training process, which can perform rapid learning with few samples by utilizing prior knowledge. In this paper, we focus on few-shot classification to conduct a survey about the recent methods. First, we elaborate on the definition of the few-shot classification problem. Then we propose a newly organized taxonomy, discuss the application scenarios in which each method is effective, and compare the pros and cons of different methods. We classify few-shot image classification methods from four perspectives: (i) Data augmentation, which contains sample-level and task-level data augmentation. (ii) Metric-based method, which analyzes both feature embedding and metric function. (iii) Optimization method, which is compared from the aspects of self-learning and mutual learning. (iv) Model-based method, which is discussed from the perspectives of memory-based, rapid adaptation and multi-task learning. Finally, we conduct the conclusion and prospect of this paper. Frontiers Media S.A. 2023-01-05 /pmc/articles/PMC9849670/ /pubmed/36686199 http://dx.doi.org/10.3389/fncom.2022.1075294 Text en Copyright © 2023 Zhang and Liu. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Zhang, Rujun
Liu, Qifan
Learning with few samples in deep learning for image classification, a mini-review
title Learning with few samples in deep learning for image classification, a mini-review
title_full Learning with few samples in deep learning for image classification, a mini-review
title_fullStr Learning with few samples in deep learning for image classification, a mini-review
title_full_unstemmed Learning with few samples in deep learning for image classification, a mini-review
title_short Learning with few samples in deep learning for image classification, a mini-review
title_sort learning with few samples in deep learning for image classification, a mini-review
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9849670/
https://www.ncbi.nlm.nih.gov/pubmed/36686199
http://dx.doi.org/10.3389/fncom.2022.1075294
work_keys_str_mv AT zhangrujun learningwithfewsamplesindeeplearningforimageclassificationaminireview
AT liuqifan learningwithfewsamplesindeeplearningforimageclassificationaminireview