21774 articles – 15587 references  [version française]

hal-00203354, version 1

Entropy based principle and generalized contingency tables

Vincent Vigneron () 1

14th European Symposium on Artificial Neural Networks (ESANN 2006) (2006) 383-389

Abstract: It is well known that the entropy-based concept of mutual information provides a measure of dependence between two discrete random variables. There are several ways to normalize this measure in order to obtain a coefficient simiar e.g. to Pearson's coefficient of contingency. This paper presents a measure of independence between categorical variables and is applied for clustering of multidimensional contingency tables. We propose and study a class of measures of directed discrepancy. Two factors make our divergence function attractive: first, the coefficient we obtain a framework in which a Bregman divergence can be used for the objective function ; second, we allow speciafication of a larger class of constraints that preserves varous statistics.

  • 1:  Informatique, Biologie Intégrative et Systèmes Complexes (IBISC)
  • CNRS : FRE2873 – Université d'Evry-Val d'Essonne
  • Domain : Statistics/Statistics Theory
    Mathematics/Statistics
 
  • hal-00203354, version 1
  • oai:hal.archives-ouvertes.fr:hal-00203354
  • From: 
  • Submitted on: Thursday, 24 January 2008 11:05:06
  • Updated on: Wednesday, 15 April 2009 14:53:04