Cargando…
Word Embedding Distribution Propagation Graph Network for Few-Shot Learning
Few-shot learning (FSL) is of great significance to the field of machine learning. The ability to learn and generalize using a small number of samples is an obvious distinction between artificial intelligence and humans. In the FSL domain, most graph neural networks (GNNs) focus on transferring labe...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9002792/ https://www.ncbi.nlm.nih.gov/pubmed/35408261 http://dx.doi.org/10.3390/s22072648 |
_version_ | 1784685975195090944 |
---|---|
author | Zhu, Chaoran Wang, Ling Han, Cheng |
author_facet | Zhu, Chaoran Wang, Ling Han, Cheng |
author_sort | Zhu, Chaoran |
collection | PubMed |
description | Few-shot learning (FSL) is of great significance to the field of machine learning. The ability to learn and generalize using a small number of samples is an obvious distinction between artificial intelligence and humans. In the FSL domain, most graph neural networks (GNNs) focus on transferring labeled sample information to an unlabeled query sample, ignoring the important role of semantic information during the classification process. Our proposed method embeds semantic information of classes into a GNN, creating a word embedding distribution propagation graph network (WPGN) for FSL. We merge the attention mechanism with our backbone network, use the Mahalanobis distance to calculate the similarity of classes, select the Funnel ReLU (FReLU) function as the activation function of the Transform layer, and update the point graph and word embedding distribution graph. In extensive experiments on FSL benchmarks, compared with the baseline model, the accuracy of the WPGN on the 5-way-1/2/5 shot tasks increased by 9.03, 4.56, and 4.15%, respectively. |
format | Online Article Text |
id | pubmed-9002792 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-90027922022-04-13 Word Embedding Distribution Propagation Graph Network for Few-Shot Learning Zhu, Chaoran Wang, Ling Han, Cheng Sensors (Basel) Article Few-shot learning (FSL) is of great significance to the field of machine learning. The ability to learn and generalize using a small number of samples is an obvious distinction between artificial intelligence and humans. In the FSL domain, most graph neural networks (GNNs) focus on transferring labeled sample information to an unlabeled query sample, ignoring the important role of semantic information during the classification process. Our proposed method embeds semantic information of classes into a GNN, creating a word embedding distribution propagation graph network (WPGN) for FSL. We merge the attention mechanism with our backbone network, use the Mahalanobis distance to calculate the similarity of classes, select the Funnel ReLU (FReLU) function as the activation function of the Transform layer, and update the point graph and word embedding distribution graph. In extensive experiments on FSL benchmarks, compared with the baseline model, the accuracy of the WPGN on the 5-way-1/2/5 shot tasks increased by 9.03, 4.56, and 4.15%, respectively. MDPI 2022-03-30 /pmc/articles/PMC9002792/ /pubmed/35408261 http://dx.doi.org/10.3390/s22072648 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Zhu, Chaoran Wang, Ling Han, Cheng Word Embedding Distribution Propagation Graph Network for Few-Shot Learning |
title | Word Embedding Distribution Propagation Graph Network for Few-Shot Learning |
title_full | Word Embedding Distribution Propagation Graph Network for Few-Shot Learning |
title_fullStr | Word Embedding Distribution Propagation Graph Network for Few-Shot Learning |
title_full_unstemmed | Word Embedding Distribution Propagation Graph Network for Few-Shot Learning |
title_short | Word Embedding Distribution Propagation Graph Network for Few-Shot Learning |
title_sort | word embedding distribution propagation graph network for few-shot learning |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9002792/ https://www.ncbi.nlm.nih.gov/pubmed/35408261 http://dx.doi.org/10.3390/s22072648 |
work_keys_str_mv | AT zhuchaoran wordembeddingdistributionpropagationgraphnetworkforfewshotlearning AT wangling wordembeddingdistributionpropagationgraphnetworkforfewshotlearning AT hancheng wordembeddingdistributionpropagationgraphnetworkforfewshotlearning |