Cargando…
Harnessing heterogeneity in space with statistically guided meta-learning
Spatial data are ubiquitous, massively collected, and widely used to support critical decision-making in many societal domains, including public health (e.g., COVID-19 pandemic control), agricultural crop monitoring, transportation, etc. While recent advances in machine learning and deep learning of...
Autores principales: | , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Springer London
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9994417/ https://www.ncbi.nlm.nih.gov/pubmed/37035130 http://dx.doi.org/10.1007/s10115-023-01847-0 |
_version_ | 1784902628301340672 |
---|---|
author | Xie, Yiqun Chen, Weiye He, Erhu Jia, Xiaowei Bao, Han Zhou, Xun Ghosh, Rahul Ravirathinam, Praveen |
author_facet | Xie, Yiqun Chen, Weiye He, Erhu Jia, Xiaowei Bao, Han Zhou, Xun Ghosh, Rahul Ravirathinam, Praveen |
author_sort | Xie, Yiqun |
collection | PubMed |
description | Spatial data are ubiquitous, massively collected, and widely used to support critical decision-making in many societal domains, including public health (e.g., COVID-19 pandemic control), agricultural crop monitoring, transportation, etc. While recent advances in machine learning and deep learning offer new promising ways to mine such rich datasets (e.g., satellite imagery, COVID statistics), spatial heterogeneity—an intrinsic characteristic embedded in spatial data—poses a major challenge as data distributions or generative processes often vary across space at different scales, with their spatial extents unknown. Recent studies (e.g., SVANN, spatial ensemble) targeting this difficult problem either require a known space-partitioning as the input, or can only support very limited number of partitions or classes (e.g., two) due to the decrease in training data size and the complexity of analysis. To address these limitations, we propose a model-agnostic framework to automatically transform a deep learning model into a spatial-heterogeneity-aware architecture, where the learning of arbitrary space partitionings is guided by a learning-engaged generalization of multivariate scan statistic and parameters are shared based on spatial relationships. Moreover, we propose a spatial moderator to generalize learned space partitionings to new test regions. Finally, we extend the framework by integrating meta-learning-based training strategies into both spatial transformation and moderation to enhance knowledge sharing and adaptation among different processes. Experiment results on real-world datasets show that the framework can effectively capture flexibly shaped heterogeneous footprints and substantially improve prediction performances. |
format | Online Article Text |
id | pubmed-9994417 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Springer London |
record_format | MEDLINE/PubMed |
spelling | pubmed-99944172023-03-09 Harnessing heterogeneity in space with statistically guided meta-learning Xie, Yiqun Chen, Weiye He, Erhu Jia, Xiaowei Bao, Han Zhou, Xun Ghosh, Rahul Ravirathinam, Praveen Knowl Inf Syst Regular Paper Spatial data are ubiquitous, massively collected, and widely used to support critical decision-making in many societal domains, including public health (e.g., COVID-19 pandemic control), agricultural crop monitoring, transportation, etc. While recent advances in machine learning and deep learning offer new promising ways to mine such rich datasets (e.g., satellite imagery, COVID statistics), spatial heterogeneity—an intrinsic characteristic embedded in spatial data—poses a major challenge as data distributions or generative processes often vary across space at different scales, with their spatial extents unknown. Recent studies (e.g., SVANN, spatial ensemble) targeting this difficult problem either require a known space-partitioning as the input, or can only support very limited number of partitions or classes (e.g., two) due to the decrease in training data size and the complexity of analysis. To address these limitations, we propose a model-agnostic framework to automatically transform a deep learning model into a spatial-heterogeneity-aware architecture, where the learning of arbitrary space partitionings is guided by a learning-engaged generalization of multivariate scan statistic and parameters are shared based on spatial relationships. Moreover, we propose a spatial moderator to generalize learned space partitionings to new test regions. Finally, we extend the framework by integrating meta-learning-based training strategies into both spatial transformation and moderation to enhance knowledge sharing and adaptation among different processes. Experiment results on real-world datasets show that the framework can effectively capture flexibly shaped heterogeneous footprints and substantially improve prediction performances. Springer London 2023-03-08 2023 /pmc/articles/PMC9994417/ /pubmed/37035130 http://dx.doi.org/10.1007/s10115-023-01847-0 Text en © The Author(s), under exclusive licence to Springer-Verlag London Ltd., part of Springer Nature 2023, Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law. This article is made available via the PMC Open Access Subset for unrestricted research re-use and secondary analysis in any form or by any means with acknowledgement of the original source. These permissions are granted for the duration of the World Health Organization (WHO) declaration of COVID-19 as a global pandemic. |
spellingShingle | Regular Paper Xie, Yiqun Chen, Weiye He, Erhu Jia, Xiaowei Bao, Han Zhou, Xun Ghosh, Rahul Ravirathinam, Praveen Harnessing heterogeneity in space with statistically guided meta-learning |
title | Harnessing heterogeneity in space with statistically guided meta-learning |
title_full | Harnessing heterogeneity in space with statistically guided meta-learning |
title_fullStr | Harnessing heterogeneity in space with statistically guided meta-learning |
title_full_unstemmed | Harnessing heterogeneity in space with statistically guided meta-learning |
title_short | Harnessing heterogeneity in space with statistically guided meta-learning |
title_sort | harnessing heterogeneity in space with statistically guided meta-learning |
topic | Regular Paper |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9994417/ https://www.ncbi.nlm.nih.gov/pubmed/37035130 http://dx.doi.org/10.1007/s10115-023-01847-0 |
work_keys_str_mv | AT xieyiqun harnessingheterogeneityinspacewithstatisticallyguidedmetalearning AT chenweiye harnessingheterogeneityinspacewithstatisticallyguidedmetalearning AT heerhu harnessingheterogeneityinspacewithstatisticallyguidedmetalearning AT jiaxiaowei harnessingheterogeneityinspacewithstatisticallyguidedmetalearning AT baohan harnessingheterogeneityinspacewithstatisticallyguidedmetalearning AT zhouxun harnessingheterogeneityinspacewithstatisticallyguidedmetalearning AT ghoshrahul harnessingheterogeneityinspacewithstatisticallyguidedmetalearning AT ravirathinampraveen harnessingheterogeneityinspacewithstatisticallyguidedmetalearning |