Cargando…

Extending Hilbert–Schmidt Independence Criterion for Testing Conditional Independence

The Conditional Independence (CI) test is a fundamental problem in statistics. Many nonparametric CI tests have been developed, but a common challenge exists: the current methods perform poorly with a high-dimensional conditioning set. In this paper, we considered a nonparametric CI test using a ker...

Descripción completa

Detalles Bibliográficos
Autores principales: Zhang, Bingyuan, Suzuki, Joe
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10047653/
https://www.ncbi.nlm.nih.gov/pubmed/36981314
http://dx.doi.org/10.3390/e25030425
_version_ 1785013979097071616
author Zhang, Bingyuan
Suzuki, Joe
author_facet Zhang, Bingyuan
Suzuki, Joe
author_sort Zhang, Bingyuan
collection PubMed
description The Conditional Independence (CI) test is a fundamental problem in statistics. Many nonparametric CI tests have been developed, but a common challenge exists: the current methods perform poorly with a high-dimensional conditioning set. In this paper, we considered a nonparametric CI test using a kernel-based test statistic, which can be viewed as an extension of the Hilbert–Schmidt Independence Criterion (HSIC). We propose a local bootstrap method to generate samples from the null distribution [Formula: see text]. The experimental results showed that our proposed method led to a significant performance improvement compared with previous methods. In particular, our method performed well against the growth of the dimension of the conditioning set. Meanwhile, our method can be computed efficiently against the growth of the sample size and the dimension of the conditioning set.
format Online
Article
Text
id pubmed-10047653
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-100476532023-03-29 Extending Hilbert–Schmidt Independence Criterion for Testing Conditional Independence Zhang, Bingyuan Suzuki, Joe Entropy (Basel) Article The Conditional Independence (CI) test is a fundamental problem in statistics. Many nonparametric CI tests have been developed, but a common challenge exists: the current methods perform poorly with a high-dimensional conditioning set. In this paper, we considered a nonparametric CI test using a kernel-based test statistic, which can be viewed as an extension of the Hilbert–Schmidt Independence Criterion (HSIC). We propose a local bootstrap method to generate samples from the null distribution [Formula: see text]. The experimental results showed that our proposed method led to a significant performance improvement compared with previous methods. In particular, our method performed well against the growth of the dimension of the conditioning set. Meanwhile, our method can be computed efficiently against the growth of the sample size and the dimension of the conditioning set. MDPI 2023-02-26 /pmc/articles/PMC10047653/ /pubmed/36981314 http://dx.doi.org/10.3390/e25030425 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Zhang, Bingyuan
Suzuki, Joe
Extending Hilbert–Schmidt Independence Criterion for Testing Conditional Independence
title Extending Hilbert–Schmidt Independence Criterion for Testing Conditional Independence
title_full Extending Hilbert–Schmidt Independence Criterion for Testing Conditional Independence
title_fullStr Extending Hilbert–Schmidt Independence Criterion for Testing Conditional Independence
title_full_unstemmed Extending Hilbert–Schmidt Independence Criterion for Testing Conditional Independence
title_short Extending Hilbert–Schmidt Independence Criterion for Testing Conditional Independence
title_sort extending hilbert–schmidt independence criterion for testing conditional independence
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10047653/
https://www.ncbi.nlm.nih.gov/pubmed/36981314
http://dx.doi.org/10.3390/e25030425
work_keys_str_mv AT zhangbingyuan extendinghilbertschmidtindependencecriterionfortestingconditionalindependence
AT suzukijoe extendinghilbertschmidtindependencecriterionfortestingconditionalindependence