Speech animation using electromagnetic articulography as motion capture data

Abstract : Electromagnetic articulography (EMA) captures the position and orientation of a number of markers, attached to the articulators, during speech. As such, it performs the same function for speech that conventional motion capture does for full-body movements acquired with optical modalities, a long-time staple technique of the animation industry. In this paper, EMA data is processed from a motion-capture perspective and applied to the visualization of an existing multimodal corpus of articulatory data, creating a kinematic 3D model of the tongue and teeth by adapting a conventional motion capture based animation paradigm. This is accomplished using off-the-shelf, open-source software. Such an animated model can then be easily integrated into multimedia applications as a digital asset, allowing the analysis of speech production in an intuitive and accessible manner. The processing of the EMA data, its co-registration with 3D data from vocal tract magnetic resonance imaging (MRI) and dental scans, and the modeling workflow are presented in detail, and several issues discussed.
Type de document :
Communication dans un congrès
AVSP - 12th International Conference on Auditory-Visual Speech Processing - 2013, Aug 2013, Annecy, France. pp.55-60, 2013
Liste complète des métadonnées

https://hal.inria.fr/hal-00835856
Contributeur : Slim Ouni <>
Soumis le : mercredi 30 octobre 2013 - 10:33:48
Dernière modification le : jeudi 11 janvier 2018 - 06:25:24
Document(s) archivé(s) le : mercredi 5 avril 2017 - 00:19:23

Fichiers

Identifiants

  • HAL Id : hal-00835856, version 1
  • ARXIV : 1310.8585

Collections

Citation

Ingmar Steiner, Korin Richmond, Slim Ouni. Speech animation using electromagnetic articulography as motion capture data. AVSP - 12th International Conference on Auditory-Visual Speech Processing - 2013, Aug 2013, Annecy, France. pp.55-60, 2013. 〈hal-00835856〉

Partager

Métriques

Consultations de la notice

300

Téléchargements de fichiers

385