Cargando…

Harnessing heterogeneity in space with statistically guided meta-learning

Spatial data are ubiquitous, massively collected, and widely used to support critical decision-making in many societal domains, including public health (e.g., COVID-19 pandemic control), agricultural crop monitoring, transportation, etc. While recent advances in machine learning and deep learning of...

Descripción completa

Detalles Bibliográficos
Autores principales: Xie, Yiqun, Chen, Weiye, He, Erhu, Jia, Xiaowei, Bao, Han, Zhou, Xun, Ghosh, Rahul, Ravirathinam, Praveen
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer London 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9994417/
https://www.ncbi.nlm.nih.gov/pubmed/37035130
http://dx.doi.org/10.1007/s10115-023-01847-0
_version_ 1784902628301340672
author Xie, Yiqun
Chen, Weiye
He, Erhu
Jia, Xiaowei
Bao, Han
Zhou, Xun
Ghosh, Rahul
Ravirathinam, Praveen
author_facet Xie, Yiqun
Chen, Weiye
He, Erhu
Jia, Xiaowei
Bao, Han
Zhou, Xun
Ghosh, Rahul
Ravirathinam, Praveen
author_sort Xie, Yiqun
collection PubMed
description Spatial data are ubiquitous, massively collected, and widely used to support critical decision-making in many societal domains, including public health (e.g., COVID-19 pandemic control), agricultural crop monitoring, transportation, etc. While recent advances in machine learning and deep learning offer new promising ways to mine such rich datasets (e.g., satellite imagery, COVID statistics), spatial heterogeneity—an intrinsic characteristic embedded in spatial data—poses a major challenge as data distributions or generative processes often vary across space at different scales, with their spatial extents unknown. Recent studies (e.g., SVANN, spatial ensemble) targeting this difficult problem either require a known space-partitioning as the input, or can only support very limited number of partitions or classes (e.g., two) due to the decrease in training data size and the complexity of analysis. To address these limitations, we propose a model-agnostic framework to automatically transform a deep learning model into a spatial-heterogeneity-aware architecture, where the learning of arbitrary space partitionings is guided by a learning-engaged generalization of multivariate scan statistic and parameters are shared based on spatial relationships. Moreover, we propose a spatial moderator to generalize learned space partitionings to new test regions. Finally, we extend the framework by integrating meta-learning-based training strategies into both spatial transformation and moderation to enhance knowledge sharing and adaptation among different processes. Experiment results on real-world datasets show that the framework can effectively capture flexibly shaped heterogeneous footprints and substantially improve prediction performances.
format Online
Article
Text
id pubmed-9994417
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Springer London
record_format MEDLINE/PubMed
spelling pubmed-99944172023-03-09 Harnessing heterogeneity in space with statistically guided meta-learning Xie, Yiqun Chen, Weiye He, Erhu Jia, Xiaowei Bao, Han Zhou, Xun Ghosh, Rahul Ravirathinam, Praveen Knowl Inf Syst Regular Paper Spatial data are ubiquitous, massively collected, and widely used to support critical decision-making in many societal domains, including public health (e.g., COVID-19 pandemic control), agricultural crop monitoring, transportation, etc. While recent advances in machine learning and deep learning offer new promising ways to mine such rich datasets (e.g., satellite imagery, COVID statistics), spatial heterogeneity—an intrinsic characteristic embedded in spatial data—poses a major challenge as data distributions or generative processes often vary across space at different scales, with their spatial extents unknown. Recent studies (e.g., SVANN, spatial ensemble) targeting this difficult problem either require a known space-partitioning as the input, or can only support very limited number of partitions or classes (e.g., two) due to the decrease in training data size and the complexity of analysis. To address these limitations, we propose a model-agnostic framework to automatically transform a deep learning model into a spatial-heterogeneity-aware architecture, where the learning of arbitrary space partitionings is guided by a learning-engaged generalization of multivariate scan statistic and parameters are shared based on spatial relationships. Moreover, we propose a spatial moderator to generalize learned space partitionings to new test regions. Finally, we extend the framework by integrating meta-learning-based training strategies into both spatial transformation and moderation to enhance knowledge sharing and adaptation among different processes. Experiment results on real-world datasets show that the framework can effectively capture flexibly shaped heterogeneous footprints and substantially improve prediction performances. Springer London 2023-03-08 2023 /pmc/articles/PMC9994417/ /pubmed/37035130 http://dx.doi.org/10.1007/s10115-023-01847-0 Text en © The Author(s), under exclusive licence to Springer-Verlag London Ltd., part of Springer Nature 2023, Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law. This article is made available via the PMC Open Access Subset for unrestricted research re-use and secondary analysis in any form or by any means with acknowledgement of the original source. These permissions are granted for the duration of the World Health Organization (WHO) declaration of COVID-19 as a global pandemic.
spellingShingle Regular Paper
Xie, Yiqun
Chen, Weiye
He, Erhu
Jia, Xiaowei
Bao, Han
Zhou, Xun
Ghosh, Rahul
Ravirathinam, Praveen
Harnessing heterogeneity in space with statistically guided meta-learning
title Harnessing heterogeneity in space with statistically guided meta-learning
title_full Harnessing heterogeneity in space with statistically guided meta-learning
title_fullStr Harnessing heterogeneity in space with statistically guided meta-learning
title_full_unstemmed Harnessing heterogeneity in space with statistically guided meta-learning
title_short Harnessing heterogeneity in space with statistically guided meta-learning
title_sort harnessing heterogeneity in space with statistically guided meta-learning
topic Regular Paper
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9994417/
https://www.ncbi.nlm.nih.gov/pubmed/37035130
http://dx.doi.org/10.1007/s10115-023-01847-0
work_keys_str_mv AT xieyiqun harnessingheterogeneityinspacewithstatisticallyguidedmetalearning
AT chenweiye harnessingheterogeneityinspacewithstatisticallyguidedmetalearning
AT heerhu harnessingheterogeneityinspacewithstatisticallyguidedmetalearning
AT jiaxiaowei harnessingheterogeneityinspacewithstatisticallyguidedmetalearning
AT baohan harnessingheterogeneityinspacewithstatisticallyguidedmetalearning
AT zhouxun harnessingheterogeneityinspacewithstatisticallyguidedmetalearning
AT ghoshrahul harnessingheterogeneityinspacewithstatisticallyguidedmetalearning
AT ravirathinampraveen harnessingheterogeneityinspacewithstatisticallyguidedmetalearning