Cargando…

Towards Semantically-Rich Spatial Network Representation Learning via Automated Feature Topic Pairing

Automated characterization of spatial data is a kind of critical geographical intelligence. As an emerging technique for characterization, spatial Representation Learning (SRL) uses deep neural networks (DNNs) to learn non-linear embedded features of spatial data for characterization. However, SRL e...

Descripción completa

Detalles Bibliográficos
Autores principales: Wang, Dongjie, Liu, Kunpeng, Mohaisen, David, Wang, Pengyang, Lu, Chang-Tien, Fu, Yanjie
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8564394/
https://www.ncbi.nlm.nih.gov/pubmed/34746772
http://dx.doi.org/10.3389/fdata.2021.762899
_version_ 1784593609629106176
author Wang, Dongjie
Liu, Kunpeng
Mohaisen, David
Wang, Pengyang
Lu, Chang-Tien
Fu, Yanjie
author_facet Wang, Dongjie
Liu, Kunpeng
Mohaisen, David
Wang, Pengyang
Lu, Chang-Tien
Fu, Yanjie
author_sort Wang, Dongjie
collection PubMed
description Automated characterization of spatial data is a kind of critical geographical intelligence. As an emerging technique for characterization, spatial Representation Learning (SRL) uses deep neural networks (DNNs) to learn non-linear embedded features of spatial data for characterization. However, SRL extracts features by internal layers of DNNs, and thus suffers from lacking semantic labels. Texts of spatial entities, on the other hand, provide semantic understanding of latent feature labels, but is insensible to deep SRL models. How can we teach a SRL model to discover appropriate topic labels in texts and pair learned features with the labels? This paper formulates a new problem: feature-topic pairing, and proposes a novel Particle Swarm Optimization (PSO) based deep learning framework. Specifically, we formulate the feature-topic pairing problem into an automated alignment task between 1) a latent embedding feature space and 2) a textual semantic topic space. We decompose the alignment of the two spaces into: 1) point-wise alignment, denoting the correlation between a topic distribution and an embedding vector; 2) pair-wise alignment, denoting the consistency between a feature-feature similarity matrix and a topic-topic similarity matrix. We design a PSO based solver to simultaneously select an optimal set of topics and learn corresponding features based on the selected topics. We develop a closed loop algorithm to iterate between 1) minimizing losses of representation reconstruction and feature-topic alignment and 2) searching the best topics. Finally, we present extensive experiments to demonstrate the enhanced performance of our method.
format Online
Article
Text
id pubmed-8564394
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-85643942021-11-04 Towards Semantically-Rich Spatial Network Representation Learning via Automated Feature Topic Pairing Wang, Dongjie Liu, Kunpeng Mohaisen, David Wang, Pengyang Lu, Chang-Tien Fu, Yanjie Front Big Data Big Data Automated characterization of spatial data is a kind of critical geographical intelligence. As an emerging technique for characterization, spatial Representation Learning (SRL) uses deep neural networks (DNNs) to learn non-linear embedded features of spatial data for characterization. However, SRL extracts features by internal layers of DNNs, and thus suffers from lacking semantic labels. Texts of spatial entities, on the other hand, provide semantic understanding of latent feature labels, but is insensible to deep SRL models. How can we teach a SRL model to discover appropriate topic labels in texts and pair learned features with the labels? This paper formulates a new problem: feature-topic pairing, and proposes a novel Particle Swarm Optimization (PSO) based deep learning framework. Specifically, we formulate the feature-topic pairing problem into an automated alignment task between 1) a latent embedding feature space and 2) a textual semantic topic space. We decompose the alignment of the two spaces into: 1) point-wise alignment, denoting the correlation between a topic distribution and an embedding vector; 2) pair-wise alignment, denoting the consistency between a feature-feature similarity matrix and a topic-topic similarity matrix. We design a PSO based solver to simultaneously select an optimal set of topics and learn corresponding features based on the selected topics. We develop a closed loop algorithm to iterate between 1) minimizing losses of representation reconstruction and feature-topic alignment and 2) searching the best topics. Finally, we present extensive experiments to demonstrate the enhanced performance of our method. Frontiers Media S.A. 2021-10-20 /pmc/articles/PMC8564394/ /pubmed/34746772 http://dx.doi.org/10.3389/fdata.2021.762899 Text en Copyright © 2021 Wang, Liu, Mohaisen, Wang, Lu and Fu. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Big Data
Wang, Dongjie
Liu, Kunpeng
Mohaisen, David
Wang, Pengyang
Lu, Chang-Tien
Fu, Yanjie
Towards Semantically-Rich Spatial Network Representation Learning via Automated Feature Topic Pairing
title Towards Semantically-Rich Spatial Network Representation Learning via Automated Feature Topic Pairing
title_full Towards Semantically-Rich Spatial Network Representation Learning via Automated Feature Topic Pairing
title_fullStr Towards Semantically-Rich Spatial Network Representation Learning via Automated Feature Topic Pairing
title_full_unstemmed Towards Semantically-Rich Spatial Network Representation Learning via Automated Feature Topic Pairing
title_short Towards Semantically-Rich Spatial Network Representation Learning via Automated Feature Topic Pairing
title_sort towards semantically-rich spatial network representation learning via automated feature topic pairing
topic Big Data
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8564394/
https://www.ncbi.nlm.nih.gov/pubmed/34746772
http://dx.doi.org/10.3389/fdata.2021.762899
work_keys_str_mv AT wangdongjie towardssemanticallyrichspatialnetworkrepresentationlearningviaautomatedfeaturetopicpairing
AT liukunpeng towardssemanticallyrichspatialnetworkrepresentationlearningviaautomatedfeaturetopicpairing
AT mohaisendavid towardssemanticallyrichspatialnetworkrepresentationlearningviaautomatedfeaturetopicpairing
AT wangpengyang towardssemanticallyrichspatialnetworkrepresentationlearningviaautomatedfeaturetopicpairing
AT luchangtien towardssemanticallyrichspatialnetworkrepresentationlearningviaautomatedfeaturetopicpairing
AT fuyanjie towardssemanticallyrichspatialnetworkrepresentationlearningviaautomatedfeaturetopicpairing