Cargando…
Learning with few samples in deep learning for image classification, a mini-review
Deep learning has achieved enormous success in various computer tasks. The excellent performance depends heavily on adequate training datasets, however, it is difficult to obtain abundant samples in practical applications. Few-shot learning is proposed to address the data limitation problem in the t...
Autores principales: | , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9849670/ https://www.ncbi.nlm.nih.gov/pubmed/36686199 http://dx.doi.org/10.3389/fncom.2022.1075294 |
_version_ | 1784872000807763968 |
---|---|
author | Zhang, Rujun Liu, Qifan |
author_facet | Zhang, Rujun Liu, Qifan |
author_sort | Zhang, Rujun |
collection | PubMed |
description | Deep learning has achieved enormous success in various computer tasks. The excellent performance depends heavily on adequate training datasets, however, it is difficult to obtain abundant samples in practical applications. Few-shot learning is proposed to address the data limitation problem in the training process, which can perform rapid learning with few samples by utilizing prior knowledge. In this paper, we focus on few-shot classification to conduct a survey about the recent methods. First, we elaborate on the definition of the few-shot classification problem. Then we propose a newly organized taxonomy, discuss the application scenarios in which each method is effective, and compare the pros and cons of different methods. We classify few-shot image classification methods from four perspectives: (i) Data augmentation, which contains sample-level and task-level data augmentation. (ii) Metric-based method, which analyzes both feature embedding and metric function. (iii) Optimization method, which is compared from the aspects of self-learning and mutual learning. (iv) Model-based method, which is discussed from the perspectives of memory-based, rapid adaptation and multi-task learning. Finally, we conduct the conclusion and prospect of this paper. |
format | Online Article Text |
id | pubmed-9849670 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-98496702023-01-20 Learning with few samples in deep learning for image classification, a mini-review Zhang, Rujun Liu, Qifan Front Comput Neurosci Neuroscience Deep learning has achieved enormous success in various computer tasks. The excellent performance depends heavily on adequate training datasets, however, it is difficult to obtain abundant samples in practical applications. Few-shot learning is proposed to address the data limitation problem in the training process, which can perform rapid learning with few samples by utilizing prior knowledge. In this paper, we focus on few-shot classification to conduct a survey about the recent methods. First, we elaborate on the definition of the few-shot classification problem. Then we propose a newly organized taxonomy, discuss the application scenarios in which each method is effective, and compare the pros and cons of different methods. We classify few-shot image classification methods from four perspectives: (i) Data augmentation, which contains sample-level and task-level data augmentation. (ii) Metric-based method, which analyzes both feature embedding and metric function. (iii) Optimization method, which is compared from the aspects of self-learning and mutual learning. (iv) Model-based method, which is discussed from the perspectives of memory-based, rapid adaptation and multi-task learning. Finally, we conduct the conclusion and prospect of this paper. Frontiers Media S.A. 2023-01-05 /pmc/articles/PMC9849670/ /pubmed/36686199 http://dx.doi.org/10.3389/fncom.2022.1075294 Text en Copyright © 2023 Zhang and Liu. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Neuroscience Zhang, Rujun Liu, Qifan Learning with few samples in deep learning for image classification, a mini-review |
title | Learning with few samples in deep learning for image classification, a mini-review |
title_full | Learning with few samples in deep learning for image classification, a mini-review |
title_fullStr | Learning with few samples in deep learning for image classification, a mini-review |
title_full_unstemmed | Learning with few samples in deep learning for image classification, a mini-review |
title_short | Learning with few samples in deep learning for image classification, a mini-review |
title_sort | learning with few samples in deep learning for image classification, a mini-review |
topic | Neuroscience |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9849670/ https://www.ncbi.nlm.nih.gov/pubmed/36686199 http://dx.doi.org/10.3389/fncom.2022.1075294 |
work_keys_str_mv | AT zhangrujun learningwithfewsamplesindeeplearningforimageclassificationaminireview AT liuqifan learningwithfewsamplesindeeplearningforimageclassificationaminireview |