Cargando…

Word Embedding Distribution Propagation Graph Network for Few-Shot Learning

Few-shot learning (FSL) is of great significance to the field of machine learning. The ability to learn and generalize using a small number of samples is an obvious distinction between artificial intelligence and humans. In the FSL domain, most graph neural networks (GNNs) focus on transferring labe...

Descripción completa

Detalles Bibliográficos
Autores principales: Zhu, Chaoran, Wang, Ling, Han, Cheng
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9002792/
https://www.ncbi.nlm.nih.gov/pubmed/35408261
http://dx.doi.org/10.3390/s22072648
_version_ 1784685975195090944
author Zhu, Chaoran
Wang, Ling
Han, Cheng
author_facet Zhu, Chaoran
Wang, Ling
Han, Cheng
author_sort Zhu, Chaoran
collection PubMed
description Few-shot learning (FSL) is of great significance to the field of machine learning. The ability to learn and generalize using a small number of samples is an obvious distinction between artificial intelligence and humans. In the FSL domain, most graph neural networks (GNNs) focus on transferring labeled sample information to an unlabeled query sample, ignoring the important role of semantic information during the classification process. Our proposed method embeds semantic information of classes into a GNN, creating a word embedding distribution propagation graph network (WPGN) for FSL. We merge the attention mechanism with our backbone network, use the Mahalanobis distance to calculate the similarity of classes, select the Funnel ReLU (FReLU) function as the activation function of the Transform layer, and update the point graph and word embedding distribution graph. In extensive experiments on FSL benchmarks, compared with the baseline model, the accuracy of the WPGN on the 5-way-1/2/5 shot tasks increased by 9.03, 4.56, and 4.15%, respectively.
format Online
Article
Text
id pubmed-9002792
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-90027922022-04-13 Word Embedding Distribution Propagation Graph Network for Few-Shot Learning Zhu, Chaoran Wang, Ling Han, Cheng Sensors (Basel) Article Few-shot learning (FSL) is of great significance to the field of machine learning. The ability to learn and generalize using a small number of samples is an obvious distinction between artificial intelligence and humans. In the FSL domain, most graph neural networks (GNNs) focus on transferring labeled sample information to an unlabeled query sample, ignoring the important role of semantic information during the classification process. Our proposed method embeds semantic information of classes into a GNN, creating a word embedding distribution propagation graph network (WPGN) for FSL. We merge the attention mechanism with our backbone network, use the Mahalanobis distance to calculate the similarity of classes, select the Funnel ReLU (FReLU) function as the activation function of the Transform layer, and update the point graph and word embedding distribution graph. In extensive experiments on FSL benchmarks, compared with the baseline model, the accuracy of the WPGN on the 5-way-1/2/5 shot tasks increased by 9.03, 4.56, and 4.15%, respectively. MDPI 2022-03-30 /pmc/articles/PMC9002792/ /pubmed/35408261 http://dx.doi.org/10.3390/s22072648 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Zhu, Chaoran
Wang, Ling
Han, Cheng
Word Embedding Distribution Propagation Graph Network for Few-Shot Learning
title Word Embedding Distribution Propagation Graph Network for Few-Shot Learning
title_full Word Embedding Distribution Propagation Graph Network for Few-Shot Learning
title_fullStr Word Embedding Distribution Propagation Graph Network for Few-Shot Learning
title_full_unstemmed Word Embedding Distribution Propagation Graph Network for Few-Shot Learning
title_short Word Embedding Distribution Propagation Graph Network for Few-Shot Learning
title_sort word embedding distribution propagation graph network for few-shot learning
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9002792/
https://www.ncbi.nlm.nih.gov/pubmed/35408261
http://dx.doi.org/10.3390/s22072648
work_keys_str_mv AT zhuchaoran wordembeddingdistributionpropagationgraphnetworkforfewshotlearning
AT wangling wordembeddingdistributionpropagationgraphnetworkforfewshotlearning
AT hancheng wordembeddingdistributionpropagationgraphnetworkforfewshotlearning