Adapting visual data to a linear articulatory model

Yves Laprie 1 Blaise Potard 1
1 PAROLE - Analysis, perception and recognition of speech
INRIA Lorraine, LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications
Abstract : The goal of this work is to investigate audiovisual-to-articulatory inversion. It is well established that acoustic-to-articulatory inversion is an underdetermined problem. On the other hand, there is strong evidence that human speakers/listeners exploit the multimodality of speech, and more particularly the articulatory cues: the view of visible articulators, i.e. jaw and lips, improves speech intelligibility. It is thus interesting to add constraints provided by the direct visual observation of the speaker's face. Visible data was obtained by stereo-vision and enable the 3D recovery of jaw and lip movements. These data were processed to fit the nature of parameters of Maeda's articulatory model. Inversion experiments were conducted.
Type de document :
Communication dans un congrès
7th International Seminar on Speech Production - ISSP 2006, Dec 2006, Sao Paulo/Brazil, 2006
Liste complète des métadonnées

Littérature citée [9 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/inria-00112223
Contributeur : Blaise Potard <>
Soumis le : mardi 7 novembre 2006 - 19:16:56
Dernière modification le : jeudi 11 janvier 2018 - 06:19:56
Document(s) archivé(s) le : mardi 6 avril 2010 - 21:50:35

Identifiants

  • HAL Id : inria-00112223, version 1

Collections

Citation

Yves Laprie, Blaise Potard. Adapting visual data to a linear articulatory model. 7th International Seminar on Speech Production - ISSP 2006, Dec 2006, Sao Paulo/Brazil, 2006. 〈inria-00112223〉

Partager

Métriques

Consultations de la notice

285

Téléchargements de fichiers

83