Skip to Main content Skip to Navigation
New interface
Conference papers

Adjonction de contraintes visuelles pour l'inversion acoustique-articulatoire

Yves Laprie 1 Blaise Potard 1 
1 PAROLE - Analysis, perception and recognition of speech
INRIA Lorraine, LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications
Abstract : The goal of this work is to investigate audiovisual-to-articulatory inversion. It is well established that acoustic-to-articulatory inversion is an under-determined problem. On the other hand, there is strong evidence that human speakers/listeners exploit the multimodality of speech, and more particularly the articulatory cues : the view of visible articulators, i.e. jaw and lips, improves speech intelligibility. It is thus interesting to add constraints provided by the direct visual observation of the speaker's face. Visible data were obtained by stereo-vision and enable the 3D recovery of jaw and lip movements. These data were processed to fit the nature of parameters of Maeda's articulatory model. Inversion experiments show that constraints on visible articulatory parameters enable relevant articulatory trajectories to be recovered and substantially reduce time required to explore the articulatory codebook.
Document type :
Conference papers
Complete list of metadata

Cited literature [11 references]  Display  Hide  Download
Contributor : Blaise Potard Connect in order to contact the contributor
Submitted on : Tuesday, November 7, 2006 - 6:56:21 PM
Last modification on : Saturday, June 25, 2022 - 7:40:29 PM
Long-term archiving on: : Tuesday, April 6, 2010 - 9:49:52 PM


  • HAL Id : inria-00112219, version 1



Yves Laprie, Blaise Potard. Adjonction de contraintes visuelles pour l'inversion acoustique-articulatoire. Journées d'Études sur la Parole - JEP 2006, Jun 2006, Dinard/France. ⟨inria-00112219⟩



Record views


Files downloads