3532 articles – 5253 Notices  [english version]

inria-00350298, version 1

Registration of Multimodal Data for Estimating the Parameters of an Articulatory Model

Michael Aron () 1, Asterios Toutios () a2, Marie-Odile Berger () a1, Erwan Kerrien () a1, Brigitte Wrobel-Dautcourt () 1, Yves Laprie () b2

IEEE International Conference on Acoustics, Speech, and Signal Processing - ICASSP 2009 (2009) 4489 - 4492

Résumé : Being able to animate a speech production model with articulatory data would open applications in many domains. In this paper, we first consider the problem of acquiring articulatory data from non invasive image and sensor modalities: dynamic ultrasound images, stereovision 3D data, electromagnetic sensors and MRI. We here especially focus on automatic registration methods which enable the fusion of the articulatory features in a common frame. We then derive articulatory parameters by fitting these features with Maeda's model. To our knowledge, it is the first attempt to derive articulatory parameters from features automatically extracted and registered between the modalities. Results prove the soundness of the approach and the reliability of the fused articulatory data.

  • a –  INRIA
  • b –  CNRS
  • 1 :  MAGRIT (INRIA Lorraine - LORIA)
  • CNRS : UMR7503 – INRIA – Université Henri Poincaré - Nancy I – Université Nancy II – Institut National Polytechnique de Lorraine (INPL)
  • 2 :  PAROLE (INRIA Lorraine - LORIA)
  • INRIA – CNRS : UMR7503 – Université Henri Poincaré - Nancy I – Université Nancy II – Institut National Polytechnique de Lorraine (INPL)
  • Domaine : Informatique/Traitement du signal et de l'image
    Sciences de l'ingénieur/Traitement du signal et de l'image
  • Mots-clés : multimodal registration – speech analysis
  • Commentaire : ISBN: 978-1-4244-2354-5
    ISSN: 1520-6149
 
  • inria-00350298, version 1
  • oai:hal.inria.fr:inria-00350298
  • Contributeur : 
  • Soumis le : Lundi 20 Septembre 2010, 09:14:26
  • Dernière modification le : Vendredi 15 Octobre 2010, 14:32:09