3530 articles – 5253 references  [version française]

hal-00184425, version 1

Visual Contribution to Speech Perception: Measuring the Intelligibility of Animated Talking Heads

Slim Ouni () 1, Michael V. Cohen 2, Hope Ishak 2, Dominic Massaro 2

EURASIP Journal on Audio, Speech, and Music Processing 2007 (2007) ID 47891

Abstract: Animated agents are becoming increasingly frequent in research and applications in speech science. An important challenge is to evaluate the effectiveness of the agent in terms of the intelligibility of its visible speech. In three experiments, we extend and test the Sumby and Pollack (1954) metric to allow the comparison of an agent relative to a standard or reference, and also propose a new metric based on the fuzzy logical model of perception (FLMP) to describe the benefit provided by a synthetic animated face relative to the benefit provided by a natural face. A valid metric would allow direct comparisons accross different experiments and would give measures of the benfit of a synthetic animated face relative to a natural face (or indeed any two conditions) and how this benefit varies as a function of the type of synthetic face, the test items (e.g., syllables versus sentences), different individuals, and applications.

  • 1:  PAROLE (INRIA Lorraine - LORIA)
  • INRIA – CNRS : UMR7503 – Université Henri Poincaré - Nancy I – Université Nancy II – Institut National Polytechnique de Lorraine (INPL)
  • 2:  Perceptual Science Laboratory (PERCEPTUAL SCIENCE LABORATORY)
  • University of California at Santa Cruz
  • Domain : Computer Science/Artificial Intelligence
    Computer Science/Computation and Language
    Cognitive science/Computer science
    Cognitive science/Linguistics
    Cognitive science/Psychology
    Humanities and Social Sciences/Linguistics
    Engineering Sciences/Signal and Image processing
    Computer Science/Signal and Image Processing
  • Keywords : intelligibility – audio-visual – talking head – communication – speech – audio – visual – animated agent – speech perception – Sumby and Pollack – natural face – synthetic face – FLMP
 
  • hal-00184425, version 1
  • http://hal.archives-ouvertes.fr/hal-00184425
  • oai:hal.archives-ouvertes.fr:hal-00184425
  • From: Slim Ouni <>
  • Submitted on: Wednesday, 31 October 2007 09:47:42
  • Updated on: Wednesday, 31 October 2007 09:47:42