s'authentifier
version française rss feed

inria-00070686, version 2

Large Margin Multi-category Discriminant Models and Scale-sensitive Psi-dimensions

Yann Guermeur () 1

N° RR-5314 (2004)

Résumé : In the context of discriminant analysis, Vapnik's statistical learning theory has mainly been developed in three directions: the computation of dichotomies with binary-valued functions, the computation of dichotomies with real-valued functions, and the computation of polychotomies with functions taking their values in finite sets. The case of classes of vector-valued functions used to compute polychotomies has seldom been considered independently, which is unsatisfactory, for three main reasons. First, this case encompasses the other ones, second, it cannot be treated appropriately through a naïve extension of the results devoted to the computation of dichotomies, third, it represents the situation most commonly met in practice. In this report, a new uniform convergence bound for large margin multi-class discriminant models is derived, which extends in a straightforward way a famous theorem by Bartlett. The capacity measure involved in this bound is a covering number. To bound from above this measure, original scale-sensitive extensions of the psi-dimensions are introduced. The covering numbers of interest can be bounded in terms of these dimensions thanks to generalizations of Sauer's lemma, as is illustrated in the specific case of the scale-sensitive Natarajan dimension. A bound on this latter dimension is then computed for the architecture of the multi-class SVMs.

  • 1 :  MODBIO (INRIA Lorraine - LORIA)
  • INRIA – CNRS : UMR7503 – Université Henri Poincaré - Nancy I – Université Nancy II – Institut National Polytechnique de Lorraine
  • Domaine : Informatique/Autre
  • Mots-clés : MULTI-CLASS DISCRIMINANT ANALYSIS / UNIFORM STRONG LAWS OF LARGE NUMBERS / GENERALIZED VC DIMENSIONS / STRUCTURAL RISK MINIMIZATION INDUCTIVE PRINCIPLE / MULTI-CLASS SVMS
  • Référence interne : RR-5314
  • Versions disponibles :  v1 (31-05-2006) v2 (20-09-2006)
 
  • inria-00070686, version 2
  • oai:hal.inria.fr:inria-00070686
  • Contributeur : 
  • Soumis le : Mercredi 20 Septembre 2006, 10:10:36
  • Dernière modification le : Vendredi 6 Octobre 2006, 13:18:09
tous les articles de la base du CCSd...
tous les articles de la base du CCSd...
tous les articles de la base du CCSd...
tous les articles de la base du CCSd...
tous les articles de la base du CCSd...
tous les articles de la base du CCSd...
tous les articles de la base du CCSd...
tous les articles de la base du CCSd...
tous les articles de la base du CCSd...
tous les articles de la base du CCSd...
tous les articles de la base du CCSd...
tous les articles de la base du CCSd...
tous les articles de la base du CCSd...
tous les articles de la base du CCSd...
tous les articles de la base du CCSd...
tous les articles de la base du CCSd...
tous les articles de la base du CCSd...
tous les articles de la base du CCSd...
tous les articles de la base du CCSd...