Cargando…

Inference and uncertainty quantification for noisy matrix completion

Noisy matrix completion aims at estimating a low-rank matrix given only partial and corrupted entries. Despite remarkable progress in designing efficient estimation algorithms, it remains largely unclear how to assess the uncertainty of the obtained estimates and how to perform efficient statistical...

Descripción completa

Detalles Bibliográficos
Autores principales: Chen, Yuxin, Fan, Jianqing, Ma, Cong, Yan, Yuling
Formato: Online Artículo Texto
Lenguaje:English
Publicado: National Academy of Sciences 2019
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6859358/
https://www.ncbi.nlm.nih.gov/pubmed/31666329
http://dx.doi.org/10.1073/pnas.1910053116
_version_ 1783471105583874048
author Chen, Yuxin
Fan, Jianqing
Ma, Cong
Yan, Yuling
author_facet Chen, Yuxin
Fan, Jianqing
Ma, Cong
Yan, Yuling
author_sort Chen, Yuxin
collection PubMed
description Noisy matrix completion aims at estimating a low-rank matrix given only partial and corrupted entries. Despite remarkable progress in designing efficient estimation algorithms, it remains largely unclear how to assess the uncertainty of the obtained estimates and how to perform efficient statistical inference on the unknown matrix (e.g., constructing a valid and short confidence interval for an unseen entry). This paper takes a substantial step toward addressing such tasks. We develop a simple procedure to compensate for the bias of the widely used convex and nonconvex estimators. The resulting debiased estimators admit nearly precise nonasymptotic distributional characterizations, which in turn enable optimal construction of confidence intervals/regions for, say, the missing entries and the low-rank factors. Our inferential procedures do not require sample splitting, thus avoiding unnecessary loss of data efficiency. As a byproduct, we obtain a sharp characterization of the estimation accuracy of our debiased estimators in both rate and constant. Our debiased estimators are tractable algorithms that provably achieve full statistical efficiency.
format Online
Article
Text
id pubmed-6859358
institution National Center for Biotechnology Information
language English
publishDate 2019
publisher National Academy of Sciences
record_format MEDLINE/PubMed
spelling pubmed-68593582019-11-21 Inference and uncertainty quantification for noisy matrix completion Chen, Yuxin Fan, Jianqing Ma, Cong Yan, Yuling Proc Natl Acad Sci U S A Physical Sciences Noisy matrix completion aims at estimating a low-rank matrix given only partial and corrupted entries. Despite remarkable progress in designing efficient estimation algorithms, it remains largely unclear how to assess the uncertainty of the obtained estimates and how to perform efficient statistical inference on the unknown matrix (e.g., constructing a valid and short confidence interval for an unseen entry). This paper takes a substantial step toward addressing such tasks. We develop a simple procedure to compensate for the bias of the widely used convex and nonconvex estimators. The resulting debiased estimators admit nearly precise nonasymptotic distributional characterizations, which in turn enable optimal construction of confidence intervals/regions for, say, the missing entries and the low-rank factors. Our inferential procedures do not require sample splitting, thus avoiding unnecessary loss of data efficiency. As a byproduct, we obtain a sharp characterization of the estimation accuracy of our debiased estimators in both rate and constant. Our debiased estimators are tractable algorithms that provably achieve full statistical efficiency. National Academy of Sciences 2019-11-12 2019-10-30 /pmc/articles/PMC6859358/ /pubmed/31666329 http://dx.doi.org/10.1073/pnas.1910053116 Text en Copyright © 2019 the Author(s). Published by PNAS. https://creativecommons.org/licenses/by-nc-nd/4.0/ https://creativecommons.org/licenses/by-nc-nd/4.0/This open access article is distributed under Creative Commons Attribution-NonCommercial-NoDerivatives License 4.0 (CC BY-NC-ND) (https://creativecommons.org/licenses/by-nc-nd/4.0/) .
spellingShingle Physical Sciences
Chen, Yuxin
Fan, Jianqing
Ma, Cong
Yan, Yuling
Inference and uncertainty quantification for noisy matrix completion
title Inference and uncertainty quantification for noisy matrix completion
title_full Inference and uncertainty quantification for noisy matrix completion
title_fullStr Inference and uncertainty quantification for noisy matrix completion
title_full_unstemmed Inference and uncertainty quantification for noisy matrix completion
title_short Inference and uncertainty quantification for noisy matrix completion
title_sort inference and uncertainty quantification for noisy matrix completion
topic Physical Sciences
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6859358/
https://www.ncbi.nlm.nih.gov/pubmed/31666329
http://dx.doi.org/10.1073/pnas.1910053116
work_keys_str_mv AT chenyuxin inferenceanduncertaintyquantificationfornoisymatrixcompletion
AT fanjianqing inferenceanduncertaintyquantificationfornoisymatrixcompletion
AT macong inferenceanduncertaintyquantificationfornoisymatrixcompletion
AT yanyuling inferenceanduncertaintyquantificationfornoisymatrixcompletion