Recognizing Speech in a Novel Accent: The Motor Theory of Speech Perception Reframed

Clément Moulin-Frier 1, 2, * M. A. Arbib 3
* Auteur correspondant
1 Flowers - Flowing Epigenetic Robots and Systems
Inria Bordeaux - Sud-Ouest, U2IS - Unité d'Informatique et d'Ingénierie des Systèmes
3 USC Brain Project
USC - University of Southern California
Abstract : The motor theory of speech perception holds that we perceive the speech of another in terms of a motor representation of that speech. However, when we have learned to recognize a foreign accent, it seems plausible that recognition of a word rarely involves reconstruction of the speech gestures of the speaker rather than the listener. To better assess the motor theory and this observation, we proceed in three stages. Part 1 places the motor theory of speech perception in a larger framework based on our earlier models of the adaptive formation of mirror neurons for grasping, and for viewing extensions of that mirror system as part of a larger system for neuro-linguistic processing, augmented by the present consideration of recognizing speech in a novel accent. Part 2 then offers a novel computational model of how a listener comes to understand the speech of someone speaking the listener's native language with a foreign accent. The core tenet of the model is that the listener uses hypotheses about the word the speaker is currently uttering to update probabilities linking the sound produced by the speaker to phonemes in the native language repertoire of the listener. This, on average, improves the recognition of later words. This model is neutral regarding the nature of the representations it uses (motor vs. auditory). It serve as a reference point for the discussion in Part 3, which proposes a dual-stream neuro-linguistic architecture to revisits claims for and against the motor theory of speech perception and the relevance of mirror neurons, and extracts some implications for the reframing of the motor theory.
Type de document :
Article dans une revue
Biological Cybernetics (Modeling), Springer Verlag, 2013, 107 (4), pp.421-447. 〈http://link.springer.com/article/10.1007%2Fs00422-013-0557-3〉. 〈10.1007/s00422-013-0557-3〉
Liste complète des métadonnées

Littérature citée [67 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-00864213
Contributeur : Clément Moulin-Frier <>
Soumis le : vendredi 20 septembre 2013 - 15:27:28
Dernière modification le : jeudi 12 avril 2018 - 13:06:49
Document(s) archivé(s) le : vendredi 7 avril 2017 - 00:42:12

Fichiers

Moulin-Frier_Arbib_2013.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Citation

Clément Moulin-Frier, M. A. Arbib. Recognizing Speech in a Novel Accent: The Motor Theory of Speech Perception Reframed. Biological Cybernetics (Modeling), Springer Verlag, 2013, 107 (4), pp.421-447. 〈http://link.springer.com/article/10.1007%2Fs00422-013-0557-3〉. 〈10.1007/s00422-013-0557-3〉. 〈hal-00864213〉

Partager

Métriques

Consultations de la notice

644

Téléchargements de fichiers

647