Cargando…
Inference and uncertainty quantification for noisy matrix completion
Noisy matrix completion aims at estimating a low-rank matrix given only partial and corrupted entries. Despite remarkable progress in designing efficient estimation algorithms, it remains largely unclear how to assess the uncertainty of the obtained estimates and how to perform efficient statistical...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
National Academy of Sciences
2019
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6859358/ https://www.ncbi.nlm.nih.gov/pubmed/31666329 http://dx.doi.org/10.1073/pnas.1910053116 |
_version_ | 1783471105583874048 |
---|---|
author | Chen, Yuxin Fan, Jianqing Ma, Cong Yan, Yuling |
author_facet | Chen, Yuxin Fan, Jianqing Ma, Cong Yan, Yuling |
author_sort | Chen, Yuxin |
collection | PubMed |
description | Noisy matrix completion aims at estimating a low-rank matrix given only partial and corrupted entries. Despite remarkable progress in designing efficient estimation algorithms, it remains largely unclear how to assess the uncertainty of the obtained estimates and how to perform efficient statistical inference on the unknown matrix (e.g., constructing a valid and short confidence interval for an unseen entry). This paper takes a substantial step toward addressing such tasks. We develop a simple procedure to compensate for the bias of the widely used convex and nonconvex estimators. The resulting debiased estimators admit nearly precise nonasymptotic distributional characterizations, which in turn enable optimal construction of confidence intervals/regions for, say, the missing entries and the low-rank factors. Our inferential procedures do not require sample splitting, thus avoiding unnecessary loss of data efficiency. As a byproduct, we obtain a sharp characterization of the estimation accuracy of our debiased estimators in both rate and constant. Our debiased estimators are tractable algorithms that provably achieve full statistical efficiency. |
format | Online Article Text |
id | pubmed-6859358 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2019 |
publisher | National Academy of Sciences |
record_format | MEDLINE/PubMed |
spelling | pubmed-68593582019-11-21 Inference and uncertainty quantification for noisy matrix completion Chen, Yuxin Fan, Jianqing Ma, Cong Yan, Yuling Proc Natl Acad Sci U S A Physical Sciences Noisy matrix completion aims at estimating a low-rank matrix given only partial and corrupted entries. Despite remarkable progress in designing efficient estimation algorithms, it remains largely unclear how to assess the uncertainty of the obtained estimates and how to perform efficient statistical inference on the unknown matrix (e.g., constructing a valid and short confidence interval for an unseen entry). This paper takes a substantial step toward addressing such tasks. We develop a simple procedure to compensate for the bias of the widely used convex and nonconvex estimators. The resulting debiased estimators admit nearly precise nonasymptotic distributional characterizations, which in turn enable optimal construction of confidence intervals/regions for, say, the missing entries and the low-rank factors. Our inferential procedures do not require sample splitting, thus avoiding unnecessary loss of data efficiency. As a byproduct, we obtain a sharp characterization of the estimation accuracy of our debiased estimators in both rate and constant. Our debiased estimators are tractable algorithms that provably achieve full statistical efficiency. National Academy of Sciences 2019-11-12 2019-10-30 /pmc/articles/PMC6859358/ /pubmed/31666329 http://dx.doi.org/10.1073/pnas.1910053116 Text en Copyright © 2019 the Author(s). Published by PNAS. https://creativecommons.org/licenses/by-nc-nd/4.0/ https://creativecommons.org/licenses/by-nc-nd/4.0/This open access article is distributed under Creative Commons Attribution-NonCommercial-NoDerivatives License 4.0 (CC BY-NC-ND) (https://creativecommons.org/licenses/by-nc-nd/4.0/) . |
spellingShingle | Physical Sciences Chen, Yuxin Fan, Jianqing Ma, Cong Yan, Yuling Inference and uncertainty quantification for noisy matrix completion |
title | Inference and uncertainty quantification for noisy matrix completion |
title_full | Inference and uncertainty quantification for noisy matrix completion |
title_fullStr | Inference and uncertainty quantification for noisy matrix completion |
title_full_unstemmed | Inference and uncertainty quantification for noisy matrix completion |
title_short | Inference and uncertainty quantification for noisy matrix completion |
title_sort | inference and uncertainty quantification for noisy matrix completion |
topic | Physical Sciences |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6859358/ https://www.ncbi.nlm.nih.gov/pubmed/31666329 http://dx.doi.org/10.1073/pnas.1910053116 |
work_keys_str_mv | AT chenyuxin inferenceanduncertaintyquantificationfornoisymatrixcompletion AT fanjianqing inferenceanduncertaintyquantificationfornoisymatrixcompletion AT macong inferenceanduncertaintyquantificationfornoisymatrixcompletion AT yanyuling inferenceanduncertaintyquantificationfornoisymatrixcompletion |