Artimate: an articulatory animation framework for audiovisual speech synthesis

Ingmar Steiner 1 Slim Ouni 1
1 PAROLE - Analysis, perception and recognition of speech
Inria Nancy - Grand Est, LORIA - NLPKD - Department of Natural Language Processing & Knowledge Discovery
Abstract : We present a modular framework for articulatory animation synthesis using speech motion capture data obtained with electromagnetic articulography (EMA). Adapting a skeletal animation approach, the articulatory motion data is applied to a three-dimensional (3D) model of the vocal tract, creating a portable resource that can be integrated in an audiovisual (AV) speech synthesis platform to provide realistic animation of the tongue and teeth for a virtual character. The framework also provides an interface to articulatory animation synthesis, as well as an example application to illustrate its use with a 3D game engine. We rely on cross-platform, open-source software and open standards to provide a lightweight, accessible, and portable workflow.
Type de document :
Communication dans un congrès
John Kane. Workshop on Innovation and Applications in Speech Technology, Mar 2012, Dublin, Ireland. 2012
Liste complète des métadonnées

https://hal.inria.fr/hal-00678964
Contributeur : Ingmar Steiner <>
Soumis le : jeudi 15 mars 2012 - 10:20:44
Dernière modification le : jeudi 11 janvier 2018 - 06:25:24
Document(s) archivé(s) le : mercredi 14 décembre 2016 - 13:15:09

Fichiers

Identifiants

  • HAL Id : hal-00678964, version 1
  • ARXIV : 1203.3574

Collections

Citation

Ingmar Steiner, Slim Ouni. Artimate: an articulatory animation framework for audiovisual speech synthesis. John Kane. Workshop on Innovation and Applications in Speech Technology, Mar 2012, Dublin, Ireland. 2012. 〈hal-00678964〉

Partager

Métriques

Consultations de la notice

322

Téléchargements de fichiers

153