Cargando…
Minimax Rates of ℓ(p)-Losses for High-Dimensional Linear Errors-in-Variables Models over ℓ(q)-Balls
In this paper, the high-dimensional linear regression model is considered, where the covariates are measured with additive noise. Different from most of the other methods, which are based on the assumption that the true covariates are fully obtained, results in this paper only require that the corru...
Autores principales: | , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8226897/ https://www.ncbi.nlm.nih.gov/pubmed/34198925 http://dx.doi.org/10.3390/e23060722 |
_version_ | 1783712396556107776 |
---|---|
author | Li, Xin Wu, Dongya |
author_facet | Li, Xin Wu, Dongya |
author_sort | Li, Xin |
collection | PubMed |
description | In this paper, the high-dimensional linear regression model is considered, where the covariates are measured with additive noise. Different from most of the other methods, which are based on the assumption that the true covariates are fully obtained, results in this paper only require that the corrupted covariate matrix is observed. Then, by the application of information theory, the minimax rates of convergence for estimation are investigated in terms of the [Formula: see text]-losses under the general sparsity assumption on the underlying regression parameter and some regularity conditions on the observed covariate matrix. The established lower and upper bounds on minimax risks agree up to constant factors when [Formula: see text] , which together provide the information-theoretic limits of estimating a sparse vector in the high-dimensional linear errors-in-variables model. An estimator for the underlying parameter is also proposed and shown to be minimax optimal in the [Formula: see text]-loss. |
format | Online Article Text |
id | pubmed-8226897 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-82268972021-06-26 Minimax Rates of ℓ(p)-Losses for High-Dimensional Linear Errors-in-Variables Models over ℓ(q)-Balls Li, Xin Wu, Dongya Entropy (Basel) Article In this paper, the high-dimensional linear regression model is considered, where the covariates are measured with additive noise. Different from most of the other methods, which are based on the assumption that the true covariates are fully obtained, results in this paper only require that the corrupted covariate matrix is observed. Then, by the application of information theory, the minimax rates of convergence for estimation are investigated in terms of the [Formula: see text]-losses under the general sparsity assumption on the underlying regression parameter and some regularity conditions on the observed covariate matrix. The established lower and upper bounds on minimax risks agree up to constant factors when [Formula: see text] , which together provide the information-theoretic limits of estimating a sparse vector in the high-dimensional linear errors-in-variables model. An estimator for the underlying parameter is also proposed and shown to be minimax optimal in the [Formula: see text]-loss. MDPI 2021-06-05 /pmc/articles/PMC8226897/ /pubmed/34198925 http://dx.doi.org/10.3390/e23060722 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Li, Xin Wu, Dongya Minimax Rates of ℓ(p)-Losses for High-Dimensional Linear Errors-in-Variables Models over ℓ(q)-Balls |
title | Minimax Rates of ℓ(p)-Losses for High-Dimensional Linear Errors-in-Variables Models over ℓ(q)-Balls |
title_full | Minimax Rates of ℓ(p)-Losses for High-Dimensional Linear Errors-in-Variables Models over ℓ(q)-Balls |
title_fullStr | Minimax Rates of ℓ(p)-Losses for High-Dimensional Linear Errors-in-Variables Models over ℓ(q)-Balls |
title_full_unstemmed | Minimax Rates of ℓ(p)-Losses for High-Dimensional Linear Errors-in-Variables Models over ℓ(q)-Balls |
title_short | Minimax Rates of ℓ(p)-Losses for High-Dimensional Linear Errors-in-Variables Models over ℓ(q)-Balls |
title_sort | minimax rates of ℓ(p)-losses for high-dimensional linear errors-in-variables models over ℓ(q)-balls |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8226897/ https://www.ncbi.nlm.nih.gov/pubmed/34198925 http://dx.doi.org/10.3390/e23060722 |
work_keys_str_mv | AT lixin minimaxratesoflplossesforhighdimensionallinearerrorsinvariablesmodelsoverlqballs AT wudongya minimaxratesoflplossesforhighdimensionallinearerrorsinvariablesmodelsoverlqballs |