Speech animation using electromagnetic articulography as motion capture data - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2013

Speech animation using electromagnetic articulography as motion capture data

Résumé

Electromagnetic articulography (EMA) captures the position and orientation of a number of markers, attached to the articulators, during speech. As such, it performs the same function for speech that conventional motion capture does for full-body movements acquired with optical modalities, a long-time staple technique of the animation industry. In this paper, EMA data is processed from a motion-capture perspective and applied to the visualization of an existing multimodal corpus of articulatory data, creating a kinematic 3D model of the tongue and teeth by adapting a conventional motion capture based animation paradigm. This is accomplished using off-the-shelf, open-source software. Such an animated model can then be easily integrated into multimedia applications as a digital asset, allowing the analysis of speech production in an intuitive and accessible manner. The processing of the EMA data, its co-registration with 3D data from vocal tract magnetic resonance imaging (MRI) and dental scans, and the modeling workflow are presented in detail, and several issues discussed.
Fichier principal
Vignette du fichier
paper.pdf (1.15 Mo) Télécharger le fichier
poster.pdf (8.01 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Format : Autre

Dates et versions

hal-00835856 , version 1 (30-10-2013)

Identifiants

Citer

Ingmar Steiner, Korin Richmond, Slim Ouni. Speech animation using electromagnetic articulography as motion capture data. AVSP - 12th International Conference on Auditory-Visual Speech Processing - 2013, Aug 2013, Annecy, France. pp.55-60. ⟨hal-00835856⟩
386 Consultations
375 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More