Cargando…
Towards Semantically-Rich Spatial Network Representation Learning via Automated Feature Topic Pairing
Automated characterization of spatial data is a kind of critical geographical intelligence. As an emerging technique for characterization, spatial Representation Learning (SRL) uses deep neural networks (DNNs) to learn non-linear embedded features of spatial data for characterization. However, SRL e...
Autores principales: | , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8564394/ https://www.ncbi.nlm.nih.gov/pubmed/34746772 http://dx.doi.org/10.3389/fdata.2021.762899 |
_version_ | 1784593609629106176 |
---|---|
author | Wang, Dongjie Liu, Kunpeng Mohaisen, David Wang, Pengyang Lu, Chang-Tien Fu, Yanjie |
author_facet | Wang, Dongjie Liu, Kunpeng Mohaisen, David Wang, Pengyang Lu, Chang-Tien Fu, Yanjie |
author_sort | Wang, Dongjie |
collection | PubMed |
description | Automated characterization of spatial data is a kind of critical geographical intelligence. As an emerging technique for characterization, spatial Representation Learning (SRL) uses deep neural networks (DNNs) to learn non-linear embedded features of spatial data for characterization. However, SRL extracts features by internal layers of DNNs, and thus suffers from lacking semantic labels. Texts of spatial entities, on the other hand, provide semantic understanding of latent feature labels, but is insensible to deep SRL models. How can we teach a SRL model to discover appropriate topic labels in texts and pair learned features with the labels? This paper formulates a new problem: feature-topic pairing, and proposes a novel Particle Swarm Optimization (PSO) based deep learning framework. Specifically, we formulate the feature-topic pairing problem into an automated alignment task between 1) a latent embedding feature space and 2) a textual semantic topic space. We decompose the alignment of the two spaces into: 1) point-wise alignment, denoting the correlation between a topic distribution and an embedding vector; 2) pair-wise alignment, denoting the consistency between a feature-feature similarity matrix and a topic-topic similarity matrix. We design a PSO based solver to simultaneously select an optimal set of topics and learn corresponding features based on the selected topics. We develop a closed loop algorithm to iterate between 1) minimizing losses of representation reconstruction and feature-topic alignment and 2) searching the best topics. Finally, we present extensive experiments to demonstrate the enhanced performance of our method. |
format | Online Article Text |
id | pubmed-8564394 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-85643942021-11-04 Towards Semantically-Rich Spatial Network Representation Learning via Automated Feature Topic Pairing Wang, Dongjie Liu, Kunpeng Mohaisen, David Wang, Pengyang Lu, Chang-Tien Fu, Yanjie Front Big Data Big Data Automated characterization of spatial data is a kind of critical geographical intelligence. As an emerging technique for characterization, spatial Representation Learning (SRL) uses deep neural networks (DNNs) to learn non-linear embedded features of spatial data for characterization. However, SRL extracts features by internal layers of DNNs, and thus suffers from lacking semantic labels. Texts of spatial entities, on the other hand, provide semantic understanding of latent feature labels, but is insensible to deep SRL models. How can we teach a SRL model to discover appropriate topic labels in texts and pair learned features with the labels? This paper formulates a new problem: feature-topic pairing, and proposes a novel Particle Swarm Optimization (PSO) based deep learning framework. Specifically, we formulate the feature-topic pairing problem into an automated alignment task between 1) a latent embedding feature space and 2) a textual semantic topic space. We decompose the alignment of the two spaces into: 1) point-wise alignment, denoting the correlation between a topic distribution and an embedding vector; 2) pair-wise alignment, denoting the consistency between a feature-feature similarity matrix and a topic-topic similarity matrix. We design a PSO based solver to simultaneously select an optimal set of topics and learn corresponding features based on the selected topics. We develop a closed loop algorithm to iterate between 1) minimizing losses of representation reconstruction and feature-topic alignment and 2) searching the best topics. Finally, we present extensive experiments to demonstrate the enhanced performance of our method. Frontiers Media S.A. 2021-10-20 /pmc/articles/PMC8564394/ /pubmed/34746772 http://dx.doi.org/10.3389/fdata.2021.762899 Text en Copyright © 2021 Wang, Liu, Mohaisen, Wang, Lu and Fu. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Big Data Wang, Dongjie Liu, Kunpeng Mohaisen, David Wang, Pengyang Lu, Chang-Tien Fu, Yanjie Towards Semantically-Rich Spatial Network Representation Learning via Automated Feature Topic Pairing |
title | Towards Semantically-Rich Spatial Network Representation Learning via Automated Feature Topic Pairing |
title_full | Towards Semantically-Rich Spatial Network Representation Learning via Automated Feature Topic Pairing |
title_fullStr | Towards Semantically-Rich Spatial Network Representation Learning via Automated Feature Topic Pairing |
title_full_unstemmed | Towards Semantically-Rich Spatial Network Representation Learning via Automated Feature Topic Pairing |
title_short | Towards Semantically-Rich Spatial Network Representation Learning via Automated Feature Topic Pairing |
title_sort | towards semantically-rich spatial network representation learning via automated feature topic pairing |
topic | Big Data |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8564394/ https://www.ncbi.nlm.nih.gov/pubmed/34746772 http://dx.doi.org/10.3389/fdata.2021.762899 |
work_keys_str_mv | AT wangdongjie towardssemanticallyrichspatialnetworkrepresentationlearningviaautomatedfeaturetopicpairing AT liukunpeng towardssemanticallyrichspatialnetworkrepresentationlearningviaautomatedfeaturetopicpairing AT mohaisendavid towardssemanticallyrichspatialnetworkrepresentationlearningviaautomatedfeaturetopicpairing AT wangpengyang towardssemanticallyrichspatialnetworkrepresentationlearningviaautomatedfeaturetopicpairing AT luchangtien towardssemanticallyrichspatialnetworkrepresentationlearningviaautomatedfeaturetopicpairing AT fuyanjie towardssemanticallyrichspatialnetworkrepresentationlearningviaautomatedfeaturetopicpairing |