| HAL-Inria | Publications, software ... of Inria's scientists |
Conference papers
Towards a True Acoustic-Visual Speech Synthesis
Abstract : This paper presents an initial bimodal acoustic-visual synthesis system able to generate concurrently the speech signal and a 3D animation of the speaker's face. This is done by concatenating bimodal diphone units that consist of both acoustic and visual information. The latter is acquired using a stereovision technique. The proposed method addresses the problems of asyn- chrony and incoherence inherent in classic approaches to audiovisual synthesis. Unit selection is based on classic target and join costs from acoustic-only synthesis, which are augmented with a visual join cost. Preliminary results indicate the benefits of this approach, since both the synthesized speech signal and the face animation are of good quality.
Cited literature [16 references]
https://hal.inria.fr/inria-00526782
Contributor : Slim Ouni Connect in order to contact the contributor
Submitted on : Friday, October 15, 2010 - 5:08:01 PM
Last modification on : Thursday, January 20, 2022 - 5:30:25 PM
Long-term archiving on: : Monday, January 17, 2011 - 10:55:05 AM
Contributor : Slim Ouni Connect in order to contact the contributor
Submitted on : Friday, October 15, 2010 - 5:08:01 PM
Last modification on : Thursday, January 20, 2022 - 5:30:25 PM
Long-term archiving on: : Monday, January 17, 2011 - 10:55:05 AM
File
AVSP10-AT.pdf
Files produced by the author(s)