Skip to Main content Skip to Navigation
Conference papers

Acoustic and Visual Analysis of Expressive Speech: A Case Study of French Acted Speech

Slim Ouni 1 Vincent Colotte 1 Sara Dahmani 1 Soumaya Azzi 2
1 MULTISPEECH - Speech Modeling for Facilitating Oral-Based Communication
Inria Nancy - Grand Est, LORIA - NLPKD - Department of Natural Language Processing & Knowledge Discovery
Abstract : Within the framework of developing an expressive audiovisual speech synthesis, an acoustic and visual analysis of expressive acted speech is proposed in this paper. Our purpose is to identify the main characteristics of audiovisual expressions that need to be integrated during synthesis to provide believable emotions to the virtual 3D talking head. We conducted a case study of a semi-professional actor who uttered a set of sentences for 6 different emotions in addition to neutral speech. We have recorded concurrently audio and motion capture data. The acoustic and the visual data have been analyzed. The main finding is that although some expressions are not well identified, some expressions were well characterized and tied in both acoustic and visual space.
Document type :
Conference papers
Complete list of metadatas

Cited literature [14 references]  Display  Hide  Download

https://hal.inria.fr/hal-01398528
Contributor : Slim Ouni <>
Submitted on : Thursday, November 17, 2016 - 1:37:33 PM
Last modification on : Friday, May 1, 2020 - 11:50:02 AM
Document(s) archivé(s) le : Thursday, March 16, 2017 - 4:49:23 PM

File

expressive16.pdf
Files produced by the author(s)

Identifiers

Citation

Slim Ouni, Vincent Colotte, Sara Dahmani, Soumaya Azzi. Acoustic and Visual Analysis of Expressive Speech: A Case Study of French Acted Speech. Interspeech 2016, ISCA, Nov 2016, San Francisco, United States. pp.580 - 584, ⟨10.21437/Interspeech.2016-730⟩. ⟨hal-01398528⟩

Share

Metrics

Record views

431

Files downloads

429