Abstract : In this paper, we provide theoretical results on the problem of optimal stream weight selection for the multi-stream classi- fication problem. It is shown, that in the presence of estimation or modeling errors using stream weights can decrease the total classification error. Stream weight estimates are computed for various conditions. Then we turn our attention to the problem of unsupervised stream weights computation. Based on the theoretical results we propose to use models and “anti-models” (class- specific background models) to estimate stream weights. A non-linear function of the ratio of the inter- to intra-class distance is used for stream weight estimation. The proposed unsupervised stream weight estimation algorithm is evaluated on both artificial data and on the problem of audio-visual speech classification. Finally the proposed algorithm is extended to the problem of audio- visual speech recognition. It is shown that the proposed algorithms achieve results comparable to the supervised minimum-error training approach under most testing conditions.
Type de document :
Article dans une revue
IEEE Trans. on Audio, Speech and Language Processing, IEEE, 2009, 17 (3), pp.436--445
https://hal.inria.fr/inria-00438846
Contributeur : Khalid Daoudi
<>
Soumis le : vendredi 4 décembre 2009 - 19:10:38
Dernière modification le : mercredi 12 septembre 2018 - 17:46:01
Document(s) archivé(s) le : jeudi 17 juin 2010 - 19:40:54
E. Sanchez-Soto, A. Potamianos, K. Daoudi. Unsupervised Stream-Weights Computation in Classification and Recognition Tasks. IEEE Trans. on Audio, Speech and Language Processing, IEEE, 2009, 17 (3), pp.436--445. 〈inria-00438846〉
