A low variance consistent test of relative dependency

Abstract : We describe a novel non-parametric statistical hypothesis test of relative dependence between a source variable and two candidate target variables. Such a test enables us to determine whether one source variable is significantly more dependent on a first target variable or a second. Dependence is measured via the Hilbert-Schmidt Independence Criterion (HSIC), resulting in a pair of empirical dependence measures (source-target 1, source-target 2). We test whether the first dependence measure is significantly larger than the second. Modeling the covariance between these HSIC statistics leads to a provably more powerful test than the construction of independent HSIC statistics by sub-sampling. The resulting test is consistent and unbiased, and (being based on U-statistics) has favorable convergence properties. The test can be computed in quadratic time, matching the computational complexity of standard empirical HSIC estimators. The effectiveness of the test is demonstrated on several real-world problems: we identify language groups from a multilingual corpus, and we prove that tumor location is more dependent on gene expression than chromosomal imbalances. Source code is available for download at https://github.com/wbounliphone/reldep.
Liste complète des métadonnées

Cited literature [34 references]  Display  Hide  Download

https://hal.inria.fr/hal-01005828
Contributor : Matthew Blaschko <>
Submitted on : Wednesday, May 20, 2015 - 11:31:01 PM
Last modification on : Thursday, February 7, 2019 - 5:29:18 PM
Document(s) archivé(s) le : Thursday, April 20, 2017 - 5:46:45 AM

Files

relative_dependency.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01005828, version 4
  • ARXIV : 1406.3852

Citation

Wacha Bounliphone, Arthur Gretton, Arthur Tenenhaus, Matthew Blaschko. A low variance consistent test of relative dependency. International Conference on Machine Learning, Jul 2015, Lille, France. ⟨hal-01005828v4⟩

Share

Metrics

Record views

1060

Files downloads

532