Registration of Multimodal Data for Estimating the Parameters of an Articulatory Model

Michael Aron 1 Asterios Toutios 2 Marie-Odile Berger 1 Erwan Kerrien 1 Brigitte Wrobel-Dautcourt 1 Yves Laprie 2
1 MAGRIT - Visual Augmentation of Complex Environments
INRIA Lorraine, LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications
2 PAROLE - Analysis, perception and recognition of speech
INRIA Lorraine, LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications
Abstract : Being able to animate a speech production model with articulatory data would open applications in many domains. In this paper, we first consider the problem of acquiring articulatory data from non invasive image and sensor modalities: dynamic ultrasound images, stereovision 3D data, electromagnetic sensors and MRI. We here especially focus on automatic registration methods which enable the fusion of the articulatory features in a common frame. We then derive articulatory parameters by fitting these features with Maeda's model. To our knowledge, it is the first attempt to derive articulatory parameters from features automatically extracted and registered between the modalities. Results prove the soundness of the approach and the reliability of the fused articulatory data.
Type de document :
Communication dans un congrès
IEEE International Conference on Acoustics, Speech, and Signal Processing - ICASSP 2009, Apr 2009, Taipei, Taiwan. IEEE, pp.4489 - 4492, 2009, IEEE International Conference on Acoustics, Speech, and Signal Processing - Proceedings. 〈http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=4960627〉. 〈10.1109/ICASSP.2009.4960627〉
Liste complète des métadonnées

Littérature citée [9 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/inria-00350298
Contributeur : Michael Aron <>
Soumis le : lundi 20 septembre 2010 - 09:14:26
Dernière modification le : vendredi 30 mars 2018 - 10:02:03
Document(s) archivé(s) le : mardi 21 décembre 2010 - 02:21:34

Fichier

icasspAron2009.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Collections

Citation

Michael Aron, Asterios Toutios, Marie-Odile Berger, Erwan Kerrien, Brigitte Wrobel-Dautcourt, et al.. Registration of Multimodal Data for Estimating the Parameters of an Articulatory Model. IEEE International Conference on Acoustics, Speech, and Signal Processing - ICASSP 2009, Apr 2009, Taipei, Taiwan. IEEE, pp.4489 - 4492, 2009, IEEE International Conference on Acoustics, Speech, and Signal Processing - Proceedings. 〈http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=4960627〉. 〈10.1109/ICASSP.2009.4960627〉. 〈inria-00350298〉

Partager

Métriques

Consultations de la notice

364

Téléchargements de fichiers

144