Large Margin Multi-category Discriminant Models and Scale-sensitive Psi-dimensions - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Rapport (Rapport De Recherche) Année : 2004

Large Margin Multi-category Discriminant Models and Scale-sensitive Psi-dimensions

Yann Guermeur
  • Fonction : Auteur
  • PersonId : 830806

Résumé

In the context of discriminant analysis, Vapnik's statistical learning theory has mainly been developed in three directions: the computation of dichotomies with binary-valued functions, the computation of dichotomies with real-valued functions, and the computation of polychotomies with functions taking their values in finite sets. The case of classes of vector-valued functions used to compute polychotomies has seldom been considered independently, which is unsatisfactory, for three main reasons. First, this case encompasses the other ones, second, it cannot be treated appropriately through a naïve extension of the results devoted to the computation of dichotomies, third, it represents the situation most commonly met in practice. In this report, a new uniform convergence bound for large margin multi-class discriminant models is derived, which extends in a straightforward way a famous theorem by Bartlett. The capacity measure involved in this bound is a covering number. To bound from above this measure, original scale-sensitive extensions of the $\Psi$-dimensions are introduced. The covering number of interest can be bounded in terms of these dimensions through extended Sauer's lemmas, as is illustrated in the specific case of the scale-sensitive Natarajan dimension. This latter dimension is then computed for the architecture of the multi-class SVMs.
Fichier principal
Vignette du fichier
RR-5314.pdf (444.67 Ko) Télécharger le fichier

Dates et versions

inria-00070686 , version 1 (19-05-2006)
inria-00070686 , version 2 (20-09-2006)

Identifiants

  • HAL Id : inria-00070686 , version 1

Citer

Yann Guermeur. Large Margin Multi-category Discriminant Models and Scale-sensitive Psi-dimensions. [Research Report] RR-5314, 2004, pp.47. ⟨inria-00070686v1⟩

Collections

INRIA-RRRT
147 Consultations
138 Téléchargements

Partager

Gmail Facebook X LinkedIn More