Cargando…
Hierarchical Pooling in Graph Neural Networks to Enhance Classification Performance in Large Datasets
Deep learning methods predicated on convolutional neural networks and graph neural networks have enabled significant improvement in node classification and prediction when applied to graph representation with learning node embedding to effectively represent the hierarchical properties of graphs. An...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8472962/ https://www.ncbi.nlm.nih.gov/pubmed/34577277 http://dx.doi.org/10.3390/s21186070 |
_version_ | 1784574868883243008 |
---|---|
author | Pham, Hai Van Thanh, Dat Hoang Moore, Philip |
author_facet | Pham, Hai Van Thanh, Dat Hoang Moore, Philip |
author_sort | Pham, Hai Van |
collection | PubMed |
description | Deep learning methods predicated on convolutional neural networks and graph neural networks have enabled significant improvement in node classification and prediction when applied to graph representation with learning node embedding to effectively represent the hierarchical properties of graphs. An interesting approach (DiffPool) utilises a differentiable graph pooling technique which learns ‘differentiable soft cluster assignment’ for nodes at each layer of a deep graph neural network with nodes mapped on sets of clusters. However, effective control of the learning process is difficult given the inherent complexity in an ‘end-to-end’ model with the potential for a large number parameters (including the potential for redundant parameters). In this paper, we propose an approach termed FPool, which is a development of the basic method adopted in DiffPool (where pooling is applied directly to node representations). Techniques designed to enhance data classification have been created and evaluated using a number of popular and publicly available sensor datasets. Experimental results for FPool demonstrate improved classification and prediction performance when compared to alternative methods considered. Moreover, FPool shows a significant reduction in the training time over the basic DiffPool framework. |
format | Online Article Text |
id | pubmed-8472962 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-84729622021-09-28 Hierarchical Pooling in Graph Neural Networks to Enhance Classification Performance in Large Datasets Pham, Hai Van Thanh, Dat Hoang Moore, Philip Sensors (Basel) Article Deep learning methods predicated on convolutional neural networks and graph neural networks have enabled significant improvement in node classification and prediction when applied to graph representation with learning node embedding to effectively represent the hierarchical properties of graphs. An interesting approach (DiffPool) utilises a differentiable graph pooling technique which learns ‘differentiable soft cluster assignment’ for nodes at each layer of a deep graph neural network with nodes mapped on sets of clusters. However, effective control of the learning process is difficult given the inherent complexity in an ‘end-to-end’ model with the potential for a large number parameters (including the potential for redundant parameters). In this paper, we propose an approach termed FPool, which is a development of the basic method adopted in DiffPool (where pooling is applied directly to node representations). Techniques designed to enhance data classification have been created and evaluated using a number of popular and publicly available sensor datasets. Experimental results for FPool demonstrate improved classification and prediction performance when compared to alternative methods considered. Moreover, FPool shows a significant reduction in the training time over the basic DiffPool framework. MDPI 2021-09-10 /pmc/articles/PMC8472962/ /pubmed/34577277 http://dx.doi.org/10.3390/s21186070 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Pham, Hai Van Thanh, Dat Hoang Moore, Philip Hierarchical Pooling in Graph Neural Networks to Enhance Classification Performance in Large Datasets |
title | Hierarchical Pooling in Graph Neural Networks to Enhance Classification Performance in Large Datasets |
title_full | Hierarchical Pooling in Graph Neural Networks to Enhance Classification Performance in Large Datasets |
title_fullStr | Hierarchical Pooling in Graph Neural Networks to Enhance Classification Performance in Large Datasets |
title_full_unstemmed | Hierarchical Pooling in Graph Neural Networks to Enhance Classification Performance in Large Datasets |
title_short | Hierarchical Pooling in Graph Neural Networks to Enhance Classification Performance in Large Datasets |
title_sort | hierarchical pooling in graph neural networks to enhance classification performance in large datasets |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8472962/ https://www.ncbi.nlm.nih.gov/pubmed/34577277 http://dx.doi.org/10.3390/s21186070 |
work_keys_str_mv | AT phamhaivan hierarchicalpoolingingraphneuralnetworkstoenhanceclassificationperformanceinlargedatasets AT thanhdathoang hierarchicalpoolingingraphneuralnetworkstoenhanceclassificationperformanceinlargedatasets AT moorephilip hierarchicalpoolingingraphneuralnetworkstoenhanceclassificationperformanceinlargedatasets |