Acoustic and Visual Analysis of Expressive Speech: A Case Study of French Acted Speech

Slim Ouni 1 Vincent Colotte 1 Sara Dahmani 1 Soumaya Azzi 2
1 MULTISPEECH - Speech Modeling for Facilitating Oral-Based Communication
Inria Nancy - Grand Est, LORIA - NLPKD - Department of Natural Language Processing & Knowledge Discovery
2 Polytech'Clermont-Ferrand
Abstract : Within the framework of developing an expressive audiovisual speech synthesis, an acoustic and visual analysis of expressive acted speech is proposed in this paper. Our purpose is to identify the main characteristics of audiovisual expressions that need to be integrated during synthesis to provide believable emotions to the virtual 3D talking head. We conducted a case study of a semi-professional actor who uttered a set of sentences for 6 different emotions in addition to neutral speech. We have recorded concurrently audio and motion capture data. The acoustic and the visual data have been analyzed. The main finding is that although some expressions are not well identified, some expressions were well characterized and tied in both acoustic and visual space.
Keywords : expressive audiovisual speech acted speech Facial expressions
Document type :
Conference papers
Complete list of metadatas

Cited literature [14 references]  Display  Hide  Download
https://hal.inria.fr/hal-01398528
Contributor : Slim Ouni <>
Submitted on : Thursday, November 17, 2016 - 1:37:33 PM
Last modification on : Tuesday, December 18, 2018 - 4:38:02 PM
Long-term archiving on: Thursday, March 16, 2017 - 4:49:23 PM

File

expressive16.pdf
Files produced by the author(s)

Identifiers

Collections

CNRS | INRIA | PRES_CLERMONT | LORIA | LORIA-NLPKD | UNIV-LORRAINE

Citation

Slim Ouni, Vincent Colotte, Sara Dahmani, Soumaya Azzi. Acoustic and Visual Analysis of Expressive Speech: A Case Study of French Acted Speech. Interspeech 2016, ISCA, Nov 2016, San Francisco, United States. pp.580 - 584, ⟨10.21437/Interspeech.2016-730⟩. ⟨hal-01398528⟩

Export

BibTeX TEI DC DCterms EndNote

Share

Metrics

Record views

391

Files downloads

362

 

 

Contact

archive-ouverte@inria.fr