Audiovisual Generation of Social Attitudes from Neutral Stimuli

Adela Barbulescu 1, 2 Gérard Bailly 2 Rémi Ronfard 1 Maël Pouget 2
1 IMAGINE - Intuitive Modeling and Animation for Interactive Graphics & Narrative Environments
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
2 GIPSA-CRISSP - CRISSP
GIPSA-DPC - Département Parole et Cognition
Abstract : The focus of this study is the generation of expressive audiovisual speech from neutral utterances for 3D virtual actors. Taking into account the segmental and suprasegmental aspects of audiovisual speech, we propose and compare several computational frameworks for the generation of expressive speech and face animation. We notably evaluate a standard frame-based conversion approach with two other methods that postulate the existence of global prosodic audiovisual patterns that are characteristic of social attitudes. The proposed approaches are tested on a database of " Exercises in Style " [1] performed by two semi-professional actors and results are evaluated using crowdsourced perceptual tests. The first test performs a qualitative validation of the animation platform while the second is a comparative study between several expressive speech generation methods. We evaluate how the expressiveness of our audiovisual performances is perceived in comparison to resynthesized original utterances and the outputs of a purely frame-based conversion system.
Type de document :
Communication dans un congrès
1st Joint Conference on Facial Analysis, Animation and Auditory-Visual Speech Processing (FAAVSP 2015), Sep 2015, Vienne, Austria. ISCA, pp.34-39
Liste complète des métadonnées

Littérature citée [31 références]  Voir  Masquer  Télécharger


https://hal.inria.fr/hal-01178056
Contributeur : Rémi Ronfard <>
Soumis le : mardi 22 décembre 2015 - 21:26:02
Dernière modification le : lundi 30 avril 2018 - 15:02:01
Document(s) archivé(s) le : dimanche 30 avril 2017 - 00:09:16

Fichiers

audiovisual-generation-avsp-20...
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01178056, version 1

Citation

Adela Barbulescu, Gérard Bailly, Rémi Ronfard, Maël Pouget. Audiovisual Generation of Social Attitudes from Neutral Stimuli. 1st Joint Conference on Facial Analysis, Animation and Auditory-Visual Speech Processing (FAAVSP 2015), Sep 2015, Vienne, Austria. ISCA, pp.34-39. 〈hal-01178056〉

Partager

Métriques

Consultations de la notice

909

Téléchargements de fichiers

389