Cargando…

Noisy tensor completion via the sum-of-squares hierarchy

In the noisy tensor completion problem we observe m entries (whose location is chosen uniformly at random) from an unknown [Formula: see text] tensor T. We assume that T is entry-wise close to being rank r. Our goal is to fill in its missing entries using as few observations as possible. Let [Formul...

Descripción completa

Detalles Bibliográficos
Autores principales: Barak, Boaz, Moitra, Ankur
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer Berlin Heidelberg 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9187579/
https://www.ncbi.nlm.nih.gov/pubmed/35702694
http://dx.doi.org/10.1007/s10107-022-01793-9
_version_ 1784725203724533760
author Barak, Boaz
Moitra, Ankur
author_facet Barak, Boaz
Moitra, Ankur
author_sort Barak, Boaz
collection PubMed
description In the noisy tensor completion problem we observe m entries (whose location is chosen uniformly at random) from an unknown [Formula: see text] tensor T. We assume that T is entry-wise close to being rank r. Our goal is to fill in its missing entries using as few observations as possible. Let [Formula: see text] . We show that if [Formula: see text] then there is a polynomial time algorithm based on the sixth level of the sum-of-squares hierarchy for completing it. Our estimate agrees with almost all of T’s entries almost exactly and works even when our observations are corrupted by noise. This is also the first algorithm for tensor completion that works in the overcomplete case when [Formula: see text] , and in fact it works all the way up to [Formula: see text] . Our proofs are short and simple and are based on establishing a new connection between noisy tensor completion (through the language of Rademacher complexity) and the task of refuting random constraint satisfaction problems. This connection seems to have gone unnoticed even in the context of matrix completion. Furthermore, we use this connection to show matching lower bounds. Our main technical result is in characterizing the Rademacher complexity of the sequence of norms that arise in the sum-of-squares relaxations to the tensor nuclear norm. These results point to an interesting new direction: Can we explore computational vs. sample complexity tradeoffs through the sum-of-squares hierarchy?
format Online
Article
Text
id pubmed-9187579
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Springer Berlin Heidelberg
record_format MEDLINE/PubMed
spelling pubmed-91875792022-06-12 Noisy tensor completion via the sum-of-squares hierarchy Barak, Boaz Moitra, Ankur Math Program Full Length Paper In the noisy tensor completion problem we observe m entries (whose location is chosen uniformly at random) from an unknown [Formula: see text] tensor T. We assume that T is entry-wise close to being rank r. Our goal is to fill in its missing entries using as few observations as possible. Let [Formula: see text] . We show that if [Formula: see text] then there is a polynomial time algorithm based on the sixth level of the sum-of-squares hierarchy for completing it. Our estimate agrees with almost all of T’s entries almost exactly and works even when our observations are corrupted by noise. This is also the first algorithm for tensor completion that works in the overcomplete case when [Formula: see text] , and in fact it works all the way up to [Formula: see text] . Our proofs are short and simple and are based on establishing a new connection between noisy tensor completion (through the language of Rademacher complexity) and the task of refuting random constraint satisfaction problems. This connection seems to have gone unnoticed even in the context of matrix completion. Furthermore, we use this connection to show matching lower bounds. Our main technical result is in characterizing the Rademacher complexity of the sequence of norms that arise in the sum-of-squares relaxations to the tensor nuclear norm. These results point to an interesting new direction: Can we explore computational vs. sample complexity tradeoffs through the sum-of-squares hierarchy? Springer Berlin Heidelberg 2022-03-29 2022 /pmc/articles/PMC9187579/ /pubmed/35702694 http://dx.doi.org/10.1007/s10107-022-01793-9 Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Full Length Paper
Barak, Boaz
Moitra, Ankur
Noisy tensor completion via the sum-of-squares hierarchy
title Noisy tensor completion via the sum-of-squares hierarchy
title_full Noisy tensor completion via the sum-of-squares hierarchy
title_fullStr Noisy tensor completion via the sum-of-squares hierarchy
title_full_unstemmed Noisy tensor completion via the sum-of-squares hierarchy
title_short Noisy tensor completion via the sum-of-squares hierarchy
title_sort noisy tensor completion via the sum-of-squares hierarchy
topic Full Length Paper
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9187579/
https://www.ncbi.nlm.nih.gov/pubmed/35702694
http://dx.doi.org/10.1007/s10107-022-01793-9
work_keys_str_mv AT barakboaz noisytensorcompletionviathesumofsquareshierarchy
AT moitraankur noisytensorcompletionviathesumofsquareshierarchy