Cargando…

Hierarchical Pooling in Graph Neural Networks to Enhance Classification Performance in Large Datasets

Deep learning methods predicated on convolutional neural networks and graph neural networks have enabled significant improvement in node classification and prediction when applied to graph representation with learning node embedding to effectively represent the hierarchical properties of graphs. An...

Descripción completa

Detalles Bibliográficos
Autores principales: Pham, Hai Van, Thanh, Dat Hoang, Moore, Philip
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8472962/
https://www.ncbi.nlm.nih.gov/pubmed/34577277
http://dx.doi.org/10.3390/s21186070
_version_ 1784574868883243008
author Pham, Hai Van
Thanh, Dat Hoang
Moore, Philip
author_facet Pham, Hai Van
Thanh, Dat Hoang
Moore, Philip
author_sort Pham, Hai Van
collection PubMed
description Deep learning methods predicated on convolutional neural networks and graph neural networks have enabled significant improvement in node classification and prediction when applied to graph representation with learning node embedding to effectively represent the hierarchical properties of graphs. An interesting approach (DiffPool) utilises a differentiable graph pooling technique which learns ‘differentiable soft cluster assignment’ for nodes at each layer of a deep graph neural network with nodes mapped on sets of clusters. However, effective control of the learning process is difficult given the inherent complexity in an ‘end-to-end’ model with the potential for a large number parameters (including the potential for redundant parameters). In this paper, we propose an approach termed FPool, which is a development of the basic method adopted in DiffPool (where pooling is applied directly to node representations). Techniques designed to enhance data classification have been created and evaluated using a number of popular and publicly available sensor datasets. Experimental results for FPool demonstrate improved classification and prediction performance when compared to alternative methods considered. Moreover, FPool shows a significant reduction in the training time over the basic DiffPool framework.
format Online
Article
Text
id pubmed-8472962
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-84729622021-09-28 Hierarchical Pooling in Graph Neural Networks to Enhance Classification Performance in Large Datasets Pham, Hai Van Thanh, Dat Hoang Moore, Philip Sensors (Basel) Article Deep learning methods predicated on convolutional neural networks and graph neural networks have enabled significant improvement in node classification and prediction when applied to graph representation with learning node embedding to effectively represent the hierarchical properties of graphs. An interesting approach (DiffPool) utilises a differentiable graph pooling technique which learns ‘differentiable soft cluster assignment’ for nodes at each layer of a deep graph neural network with nodes mapped on sets of clusters. However, effective control of the learning process is difficult given the inherent complexity in an ‘end-to-end’ model with the potential for a large number parameters (including the potential for redundant parameters). In this paper, we propose an approach termed FPool, which is a development of the basic method adopted in DiffPool (where pooling is applied directly to node representations). Techniques designed to enhance data classification have been created and evaluated using a number of popular and publicly available sensor datasets. Experimental results for FPool demonstrate improved classification and prediction performance when compared to alternative methods considered. Moreover, FPool shows a significant reduction in the training time over the basic DiffPool framework. MDPI 2021-09-10 /pmc/articles/PMC8472962/ /pubmed/34577277 http://dx.doi.org/10.3390/s21186070 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Pham, Hai Van
Thanh, Dat Hoang
Moore, Philip
Hierarchical Pooling in Graph Neural Networks to Enhance Classification Performance in Large Datasets
title Hierarchical Pooling in Graph Neural Networks to Enhance Classification Performance in Large Datasets
title_full Hierarchical Pooling in Graph Neural Networks to Enhance Classification Performance in Large Datasets
title_fullStr Hierarchical Pooling in Graph Neural Networks to Enhance Classification Performance in Large Datasets
title_full_unstemmed Hierarchical Pooling in Graph Neural Networks to Enhance Classification Performance in Large Datasets
title_short Hierarchical Pooling in Graph Neural Networks to Enhance Classification Performance in Large Datasets
title_sort hierarchical pooling in graph neural networks to enhance classification performance in large datasets
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8472962/
https://www.ncbi.nlm.nih.gov/pubmed/34577277
http://dx.doi.org/10.3390/s21186070
work_keys_str_mv AT phamhaivan hierarchicalpoolingingraphneuralnetworkstoenhanceclassificationperformanceinlargedatasets
AT thanhdathoang hierarchicalpoolingingraphneuralnetworkstoenhanceclassificationperformanceinlargedatasets
AT moorephilip hierarchicalpoolingingraphneuralnetworkstoenhanceclassificationperformanceinlargedatasets