Skip to Main content Skip to Navigation
Conference papers

Mixing faces and voices: a study of the influence of faces and voices on audiovisual intelligibility

Jérémy Miranda 1 Slim Ouni 1
1 PAROLE - Analysis, perception and recognition of speech
Inria Nancy - Grand Est, LORIA - NLPKD - Department of Natural Language Processing & Knowledge Discovery
Abstract : This study examined the influence of mixing faces and voices on the audiovisual intelligibility. The goal is to study the effect of combining two sources of information on the audiovisual intelligibility. Cross-talker dubbing was performed between faces and voices of 10 meaningful sentences pronounced by 10 talkers: 5 females and 5 males. Human subjects were asked to rate the articulation of the output videos. Comparisons were made between results of original and dubbed video. Almost across all the combinations, the audiovisual intelligibility was acceptable. The intelligibility of the speakers varied, however. We observed an influence of the audio/visual channel on the overall intelligibility that can increase or decrease depending the intelligibility results of this channel.
Document type :
Conference papers
Complete list of metadata
Contributor : Slim Ouni Connect in order to contact the contributor
Submitted on : Tuesday, October 6, 2015 - 3:42:34 PM
Last modification on : Saturday, October 16, 2021 - 11:26:08 AM
Long-term archiving on: : Thursday, January 7, 2016 - 10:41:47 AM


Files produced by the author(s)


  • HAL Id : hal-00835855, version 1



Jérémy Miranda, Slim Ouni. Mixing faces and voices: a study of the influence of faces and voices on audiovisual intelligibility. AVSP - 12th International Conference on Auditory-Visual Speech Processing - 2013, Aug 2013, Annecy, France. ⟨hal-00835855⟩



Les métriques sont temporairement indisponibles