Cargando…

Adaptive granularity in tensors: A quest for interpretable structure

Data collected at very frequent intervals is usually extremely sparse and has no structure that is exploitable by modern tensor decomposition algorithms. Thus, the utility of such tensors is low, in terms of the amount of interpretable and exploitable structure that one can extract from them. In thi...

Descripción completa

Detalles Bibliográficos
Autores principales: Pasricha, Ravdeep S., Gujral, Ekta, Papalexakis, Evangelos E.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9727254/
https://www.ncbi.nlm.nih.gov/pubmed/36505975
http://dx.doi.org/10.3389/fdata.2022.929511
_version_ 1784844972565987328
author Pasricha, Ravdeep S.
Gujral, Ekta
Papalexakis, Evangelos E.
author_facet Pasricha, Ravdeep S.
Gujral, Ekta
Papalexakis, Evangelos E.
author_sort Pasricha, Ravdeep S.
collection PubMed
description Data collected at very frequent intervals is usually extremely sparse and has no structure that is exploitable by modern tensor decomposition algorithms. Thus, the utility of such tensors is low, in terms of the amount of interpretable and exploitable structure that one can extract from them. In this paper, we introduce the problem of finding a tensor of adaptive aggregated granularity that can be decomposed to reveal meaningful latent concepts (structures) from datasets that, in their original form, are not amenable to tensor analysis. Such datasets fall under the broad category of sparse point processes that evolve over space and/or time. To the best of our knowledge, this is the first work that explores adaptive granularity aggregation in tensors. Furthermore, we formally define the problem and discuss different definitions of “good structure” that are in practice and show that the optimal solution is of prohibitive combinatorial complexity. Subsequently, we propose an efficient and effective greedy algorithm called ICEBREAKER, which follows a number of intuitive decision criteria that locally maximize the “goodness of structure,” resulting in high-quality tensors. We evaluate our method on synthetic, semi-synthetic, and real datasets. In all the cases, our proposed method constructs tensors that have a very high structure quality.
format Online
Article
Text
id pubmed-9727254
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-97272542022-12-08 Adaptive granularity in tensors: A quest for interpretable structure Pasricha, Ravdeep S. Gujral, Ekta Papalexakis, Evangelos E. Front Big Data Big Data Data collected at very frequent intervals is usually extremely sparse and has no structure that is exploitable by modern tensor decomposition algorithms. Thus, the utility of such tensors is low, in terms of the amount of interpretable and exploitable structure that one can extract from them. In this paper, we introduce the problem of finding a tensor of adaptive aggregated granularity that can be decomposed to reveal meaningful latent concepts (structures) from datasets that, in their original form, are not amenable to tensor analysis. Such datasets fall under the broad category of sparse point processes that evolve over space and/or time. To the best of our knowledge, this is the first work that explores adaptive granularity aggregation in tensors. Furthermore, we formally define the problem and discuss different definitions of “good structure” that are in practice and show that the optimal solution is of prohibitive combinatorial complexity. Subsequently, we propose an efficient and effective greedy algorithm called ICEBREAKER, which follows a number of intuitive decision criteria that locally maximize the “goodness of structure,” resulting in high-quality tensors. We evaluate our method on synthetic, semi-synthetic, and real datasets. In all the cases, our proposed method constructs tensors that have a very high structure quality. Frontiers Media S.A. 2022-11-23 /pmc/articles/PMC9727254/ /pubmed/36505975 http://dx.doi.org/10.3389/fdata.2022.929511 Text en Copyright © 2022 Pasricha, Gujral and Papalexakis. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Big Data
Pasricha, Ravdeep S.
Gujral, Ekta
Papalexakis, Evangelos E.
Adaptive granularity in tensors: A quest for interpretable structure
title Adaptive granularity in tensors: A quest for interpretable structure
title_full Adaptive granularity in tensors: A quest for interpretable structure
title_fullStr Adaptive granularity in tensors: A quest for interpretable structure
title_full_unstemmed Adaptive granularity in tensors: A quest for interpretable structure
title_short Adaptive granularity in tensors: A quest for interpretable structure
title_sort adaptive granularity in tensors: a quest for interpretable structure
topic Big Data
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9727254/
https://www.ncbi.nlm.nih.gov/pubmed/36505975
http://dx.doi.org/10.3389/fdata.2022.929511
work_keys_str_mv AT pasricharavdeeps adaptivegranularityintensorsaquestforinterpretablestructure
AT gujralekta adaptivegranularityintensorsaquestforinterpretablestructure
AT papalexakisevangelose adaptivegranularityintensorsaquestforinterpretablestructure