Cargando…

Minimax Rates of ℓ(p)-Losses for High-Dimensional Linear Errors-in-Variables Models over ℓ(q)-Balls

In this paper, the high-dimensional linear regression model is considered, where the covariates are measured with additive noise. Different from most of the other methods, which are based on the assumption that the true covariates are fully obtained, results in this paper only require that the corru...

Descripción completa

Detalles Bibliográficos
Autores principales: Li, Xin, Wu, Dongya
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8226897/
https://www.ncbi.nlm.nih.gov/pubmed/34198925
http://dx.doi.org/10.3390/e23060722
_version_ 1783712396556107776
author Li, Xin
Wu, Dongya
author_facet Li, Xin
Wu, Dongya
author_sort Li, Xin
collection PubMed
description In this paper, the high-dimensional linear regression model is considered, where the covariates are measured with additive noise. Different from most of the other methods, which are based on the assumption that the true covariates are fully obtained, results in this paper only require that the corrupted covariate matrix is observed. Then, by the application of information theory, the minimax rates of convergence for estimation are investigated in terms of the [Formula: see text]-losses under the general sparsity assumption on the underlying regression parameter and some regularity conditions on the observed covariate matrix. The established lower and upper bounds on minimax risks agree up to constant factors when [Formula: see text] , which together provide the information-theoretic limits of estimating a sparse vector in the high-dimensional linear errors-in-variables model. An estimator for the underlying parameter is also proposed and shown to be minimax optimal in the [Formula: see text]-loss.
format Online
Article
Text
id pubmed-8226897
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-82268972021-06-26 Minimax Rates of ℓ(p)-Losses for High-Dimensional Linear Errors-in-Variables Models over ℓ(q)-Balls Li, Xin Wu, Dongya Entropy (Basel) Article In this paper, the high-dimensional linear regression model is considered, where the covariates are measured with additive noise. Different from most of the other methods, which are based on the assumption that the true covariates are fully obtained, results in this paper only require that the corrupted covariate matrix is observed. Then, by the application of information theory, the minimax rates of convergence for estimation are investigated in terms of the [Formula: see text]-losses under the general sparsity assumption on the underlying regression parameter and some regularity conditions on the observed covariate matrix. The established lower and upper bounds on minimax risks agree up to constant factors when [Formula: see text] , which together provide the information-theoretic limits of estimating a sparse vector in the high-dimensional linear errors-in-variables model. An estimator for the underlying parameter is also proposed and shown to be minimax optimal in the [Formula: see text]-loss. MDPI 2021-06-05 /pmc/articles/PMC8226897/ /pubmed/34198925 http://dx.doi.org/10.3390/e23060722 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Li, Xin
Wu, Dongya
Minimax Rates of ℓ(p)-Losses for High-Dimensional Linear Errors-in-Variables Models over ℓ(q)-Balls
title Minimax Rates of ℓ(p)-Losses for High-Dimensional Linear Errors-in-Variables Models over ℓ(q)-Balls
title_full Minimax Rates of ℓ(p)-Losses for High-Dimensional Linear Errors-in-Variables Models over ℓ(q)-Balls
title_fullStr Minimax Rates of ℓ(p)-Losses for High-Dimensional Linear Errors-in-Variables Models over ℓ(q)-Balls
title_full_unstemmed Minimax Rates of ℓ(p)-Losses for High-Dimensional Linear Errors-in-Variables Models over ℓ(q)-Balls
title_short Minimax Rates of ℓ(p)-Losses for High-Dimensional Linear Errors-in-Variables Models over ℓ(q)-Balls
title_sort minimax rates of ℓ(p)-losses for high-dimensional linear errors-in-variables models over ℓ(q)-balls
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8226897/
https://www.ncbi.nlm.nih.gov/pubmed/34198925
http://dx.doi.org/10.3390/e23060722
work_keys_str_mv AT lixin minimaxratesoflplossesforhighdimensionallinearerrorsinvariablesmodelsoverlqballs
AT wudongya minimaxratesoflplossesforhighdimensionallinearerrorsinvariablesmodelsoverlqballs