A Robust Lip Tracking System for the Acoustic to Articulatory Inversion - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2004

A Robust Lip Tracking System for the Acoustic to Articulatory Inversion

Résumé

The acoustic to articulatory inversion of speech which refers to the mapping from the acoustic signal to the articulatory, is an interesting problem. Given the acoustic signal, the recovery of the articulatory state is considered difficult. The reason is the "one-to-many" nature of the acoustic-to-articulatory inversion problem: a given articulatory state has always only one acoustic realization but an acoustic signal can be the outcome of more than one articulatory states. In order to solve the one-to-many problem of the inversion, visual information complementary to acoustic signal is used. Hence, a robust lip tracking system to provide visual information (such as the width and height of mouth) for the acoustic-to-articulatory inversion is developed in this paper. The proposed approach uses a combination of motion, color and structure information of the mouth area to track lip feature points. This technique is designed to be effective and robust. It has the advantages to detect the lip feature points automatically and recover the feature points lost during tracking process. Encouraging results have been obtained using the proposed approach.

Domaines

Autre [cs.OH]
Fichier principal
Vignette du fichier
A04-R-334.pdf (286 Ko) Télécharger le fichier

Dates et versions

inria-00099907 , version 1 (26-09-2006)

Identifiants

  • HAL Id : inria-00099907 , version 1

Citer

Jingying Chen, Yves Laprie, Marie-Odile Berger. A Robust Lip Tracking System for the Acoustic to Articulatory Inversion. 6th IASTED International Conference on Signal and Image Processing - SIP'2004, 2004, Honolulu, Hawaii, USA, 6 p. ⟨inria-00099907⟩
197 Consultations
59 Téléchargements

Partager

Gmail Facebook X LinkedIn More