Cargando…
Extending Hilbert–Schmidt Independence Criterion for Testing Conditional Independence
The Conditional Independence (CI) test is a fundamental problem in statistics. Many nonparametric CI tests have been developed, but a common challenge exists: the current methods perform poorly with a high-dimensional conditioning set. In this paper, we considered a nonparametric CI test using a ker...
Autores principales: | , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10047653/ https://www.ncbi.nlm.nih.gov/pubmed/36981314 http://dx.doi.org/10.3390/e25030425 |
_version_ | 1785013979097071616 |
---|---|
author | Zhang, Bingyuan Suzuki, Joe |
author_facet | Zhang, Bingyuan Suzuki, Joe |
author_sort | Zhang, Bingyuan |
collection | PubMed |
description | The Conditional Independence (CI) test is a fundamental problem in statistics. Many nonparametric CI tests have been developed, but a common challenge exists: the current methods perform poorly with a high-dimensional conditioning set. In this paper, we considered a nonparametric CI test using a kernel-based test statistic, which can be viewed as an extension of the Hilbert–Schmidt Independence Criterion (HSIC). We propose a local bootstrap method to generate samples from the null distribution [Formula: see text]. The experimental results showed that our proposed method led to a significant performance improvement compared with previous methods. In particular, our method performed well against the growth of the dimension of the conditioning set. Meanwhile, our method can be computed efficiently against the growth of the sample size and the dimension of the conditioning set. |
format | Online Article Text |
id | pubmed-10047653 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-100476532023-03-29 Extending Hilbert–Schmidt Independence Criterion for Testing Conditional Independence Zhang, Bingyuan Suzuki, Joe Entropy (Basel) Article The Conditional Independence (CI) test is a fundamental problem in statistics. Many nonparametric CI tests have been developed, but a common challenge exists: the current methods perform poorly with a high-dimensional conditioning set. In this paper, we considered a nonparametric CI test using a kernel-based test statistic, which can be viewed as an extension of the Hilbert–Schmidt Independence Criterion (HSIC). We propose a local bootstrap method to generate samples from the null distribution [Formula: see text]. The experimental results showed that our proposed method led to a significant performance improvement compared with previous methods. In particular, our method performed well against the growth of the dimension of the conditioning set. Meanwhile, our method can be computed efficiently against the growth of the sample size and the dimension of the conditioning set. MDPI 2023-02-26 /pmc/articles/PMC10047653/ /pubmed/36981314 http://dx.doi.org/10.3390/e25030425 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Zhang, Bingyuan Suzuki, Joe Extending Hilbert–Schmidt Independence Criterion for Testing Conditional Independence |
title | Extending Hilbert–Schmidt Independence Criterion for Testing Conditional Independence |
title_full | Extending Hilbert–Schmidt Independence Criterion for Testing Conditional Independence |
title_fullStr | Extending Hilbert–Schmidt Independence Criterion for Testing Conditional Independence |
title_full_unstemmed | Extending Hilbert–Schmidt Independence Criterion for Testing Conditional Independence |
title_short | Extending Hilbert–Schmidt Independence Criterion for Testing Conditional Independence |
title_sort | extending hilbert–schmidt independence criterion for testing conditional independence |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10047653/ https://www.ncbi.nlm.nih.gov/pubmed/36981314 http://dx.doi.org/10.3390/e25030425 |
work_keys_str_mv | AT zhangbingyuan extendinghilbertschmidtindependencecriterionfortestingconditionalindependence AT suzukijoe extendinghilbertschmidtindependencecriterionfortestingconditionalindependence |