Skip to Main content Skip to Navigation
Journal articles

Recognizing Speech in a Novel Accent: The Motor Theory of Speech Perception Reframed

Clément Moulin-Frier 1, 2, * M. A. Arbib 3
* Corresponding author
1 Flowers - Flowing Epigenetic Robots and Systems
Inria Bordeaux - Sud-Ouest, U2IS - Unité d'Informatique et d'Ingénierie des Systèmes
3 USC Brain Project
USC - University of Southern California
Abstract : The motor theory of speech perception holds that we perceive the speech of another in terms of a motor representation of that speech. However, when we have learned to recognize a foreign accent, it seems plausible that recognition of a word rarely involves reconstruction of the speech gestures of the speaker rather than the listener. To better assess the motor theory and this observation, we proceed in three stages. Part 1 places the motor theory of speech perception in a larger framework based on our earlier models of the adaptive formation of mirror neurons for grasping, and for viewing extensions of that mirror system as part of a larger system for neuro-linguistic processing, augmented by the present consideration of recognizing speech in a novel accent. Part 2 then offers a novel computational model of how a listener comes to understand the speech of someone speaking the listener's native language with a foreign accent. The core tenet of the model is that the listener uses hypotheses about the word the speaker is currently uttering to update probabilities linking the sound produced by the speaker to phonemes in the native language repertoire of the listener. This, on average, improves the recognition of later words. This model is neutral regarding the nature of the representations it uses (motor vs. auditory). It serve as a reference point for the discussion in Part 3, which proposes a dual-stream neuro-linguistic architecture to revisits claims for and against the motor theory of speech perception and the relevance of mirror neurons, and extracts some implications for the reframing of the motor theory.
Complete list of metadata

Cited literature [67 references]  Display  Hide  Download

https://hal.inria.fr/hal-00864213
Contributor : Clément Moulin-Frier <>
Submitted on : Friday, September 20, 2013 - 3:27:28 PM
Last modification on : Thursday, November 19, 2020 - 12:59:47 PM
Long-term archiving on: : Friday, April 7, 2017 - 12:42:12 AM

Files

Moulin-Frier_Arbib_2013.pdf
Files produced by the author(s)

Identifiers

Citation

Clément Moulin-Frier, M. A. Arbib. Recognizing Speech in a Novel Accent: The Motor Theory of Speech Perception Reframed. Biological Cybernetics (Modeling), Springer Verlag, 2013, 107 (4), pp.421-447. ⟨10.1007/s00422-013-0557-3⟩. ⟨hal-00864213⟩

Share

Metrics

Record views

808

Files downloads

1008