Mixing faces and voices: a study of the influence of faces and voices on audiovisual intelligibility

Jérémy Miranda 1 Slim Ouni 1
1 PAROLE - Analysis, perception and recognition of speech
Inria Nancy - Grand Est, LORIA - NLPKD - Department of Natural Language Processing & Knowledge Discovery
Abstract : This study examined the influence of mixing faces and voices on the audiovisual intelligibility. The goal is to study the effect of combining two sources of information on the audiovisual intelligibility. Cross-talker dubbing was performed between faces and voices of 10 meaningful sentences pronounced by 10 talkers: 5 females and 5 males. Human subjects were asked to rate the articulation of the output videos. Comparisons were made between results of original and dubbed video. Almost across all the combinations, the audiovisual intelligibility was acceptable. The intelligibility of the speakers varied, however. We observed an influence of the audio/visual channel on the overall intelligibility that can increase or decrease depending the intelligibility results of this channel.
Type de document :
Communication dans un congrès
AVSP - 12th International Conference on Auditory-Visual Speech Processing - 2013, Aug 2013, Annecy, France. 2013
Liste complète des métadonnées
https://hal.inria.fr/hal-00835855
Contributeur : Slim Ouni <>
Soumis le : mardi 6 octobre 2015 - 15:42:34
Dernière modification le : jeudi 11 janvier 2018 - 06:25:24
Document(s) archivé(s) le : jeudi 7 janvier 2016 - 10:41:47

Fichier

avsp-paper_53.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-00835855, version 1

Collections

INRIA | UNIV-LORRAINE | LORIA-NLPKD | LORIA

Citation

Jérémy Miranda, Slim Ouni. Mixing faces and voices: a study of the influence of faces and voices on audiovisual intelligibility. AVSP - 12th International Conference on Auditory-Visual Speech Processing - 2013, Aug 2013, Annecy, France. 2013. 〈hal-00835855〉

Exporter

BibTeX TEI DC DCterms EndNote

Partager

Métriques

Consultations de la notice

200

Téléchargements de fichiers

61

Contact


archive-ouverte@inria.fr