Mixing faces and voices: a study of the influence of faces and voices on audiovisual intelligibility

Jérémy Miranda 1 Slim Ouni 1
1 PAROLE - Analysis, perception and recognition of speech
Inria Nancy - Grand Est, LORIA - NLPKD - Department of Natural Language Processing & Knowledge Discovery
Abstract : This study examined the influence of mixing faces and voices on the audiovisual intelligibility. The goal is to study the effect of combining two sources of information on the audiovisual intelligibility. Cross-talker dubbing was performed between faces and voices of 10 meaningful sentences pronounced by 10 talkers: 5 females and 5 males. Human subjects were asked to rate the articulation of the output videos. Comparisons were made between results of original and dubbed video. Almost across all the combinations, the audiovisual intelligibility was acceptable. The intelligibility of the speakers varied, however. We observed an influence of the audio/visual channel on the overall intelligibility that can increase or decrease depending the intelligibility results of this channel.
Document type :
Conference papers
Complete list of metadatas
https://hal.inria.fr/hal-00835855
Contributor : Slim Ouni <>
Submitted on : Tuesday, October 6, 2015 - 3:42:34 PM
Last modification on : Tuesday, December 18, 2018 - 4:38:02 PM
Long-term archiving on: Thursday, January 7, 2016 - 10:41:47 AM

File

avsp-paper_53.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-00835855, version 1

Collections

CNRS | INRIA | UNIV-LORRAINE | LORIA-NLPKD | LORIA

Citation

Jérémy Miranda, Slim Ouni. Mixing faces and voices: a study of the influence of faces and voices on audiovisual intelligibility. AVSP - 12th International Conference on Auditory-Visual Speech Processing - 2013, Aug 2013, Annecy, France. ⟨hal-00835855⟩

Export

BibTeX TEI DC DCterms EndNote

Share

Metrics

Record views

278

Files downloads

97

 

 

Contact

archive-ouverte@inria.fr