Characterization of Audiovisual Dramatic Attitudes

Adela Barbulescu 1, * Rémi Ronfard 1 Gérard Bailly 2
* Corresponding author
1 IMAGINE - Intuitive Modeling and Animation for Interactive Graphics & Narrative Environments
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
2 GIPSA-CRISSP - CRISSP
GIPSA-DPC - Département Parole et Cognition
Abstract : In this work we explore the capability of audiovisual parameters (such as voice frequency, rhythm, head motion or facial expressions) to discriminate among different dramatic attitudes. We extract the audiovisual parameters from an acted corpus of attitudes and structure them as frame, syllable, and sentence-level features. Using Linear Discriminant Analysis classifiers, we show that sentence-level features present a higher discriminating rate among the attitudes and are less dependent on the speaker than frame and sylable features. We also compare the classification results with the perceptual evaluation tests, showing that voice frequency is correlated to the perceptual results for all attitudes, while other features, such as head motion, contribute differently, depending both on the attitude and the speaker.
Complete list of metadatas

Cited literature [31 references]  Display  Hide  Download

https://hal.inria.fr/hal-01337077
Contributor : Adela Barbulescu <>
Submitted on : Friday, June 24, 2016 - 2:23:46 PM
Last modification on : Monday, April 30, 2018 - 3:02:01 PM

File

characterization-audiovisual-d...
Files produced by the author(s)

Identifiers

Citation

Adela Barbulescu, Rémi Ronfard, Gérard Bailly. Characterization of Audiovisual Dramatic Attitudes. 17th Annual Conference of the International Speech Communication Association (Interspeech 2016), Sep 2016, San Francisco, United States. pp.585-589, ⟨10.21437/Interspeech.2016-75⟩. ⟨hal-01337077⟩

Share

Metrics

Record views

768

Files downloads

304