Registration of Multimodal Data for Estimating the Parameters of an Articulatory Model

Michael Aron 1 Asterios Toutios 2 Marie-Odile Berger 1 Erwan Kerrien 1 Brigitte Wrobel-Dautcourt 1 Yves Laprie 2
1 MAGRIT - Visual Augmentation of Complex Environments
INRIA Lorraine, LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications
2 PAROLE - Analysis, perception and recognition of speech
INRIA Lorraine, LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications
Abstract : Being able to animate a speech production model with articulatory data would open applications in many domains. In this paper, we first consider the problem of acquiring articulatory data from non invasive image and sensor modalities: dynamic ultrasound images, stereovision 3D data, electromagnetic sensors and MRI. We here especially focus on automatic registration methods which enable the fusion of the articulatory features in a common frame. We then derive articulatory parameters by fitting these features with Maeda's model. To our knowledge, it is the first attempt to derive articulatory parameters from features automatically extracted and registered between the modalities. Results prove the soundness of the approach and the reliability of the fused articulatory data.
Complete list of metadatas

Cited literature [9 references]  Display  Hide  Download

https://hal.inria.fr/inria-00350298
Contributor : Michael Aron <>
Submitted on : Monday, September 20, 2010 - 9:14:26 AM
Last modification on : Friday, March 30, 2018 - 10:02:03 AM
Long-term archiving on : Tuesday, December 21, 2010 - 2:21:34 AM

File

icasspAron2009.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Michael Aron, Asterios Toutios, Marie-Odile Berger, Erwan Kerrien, Brigitte Wrobel-Dautcourt, et al.. Registration of Multimodal Data for Estimating the Parameters of an Articulatory Model. IEEE International Conference on Acoustics, Speech, and Signal Processing - ICASSP 2009, Apr 2009, Taipei, Taiwan. pp.4489 - 4492, ⟨10.1109/ICASSP.2009.4960627⟩. ⟨inria-00350298⟩

Share

Metrics

Record views

413

Files downloads

224