Skip to Main content Skip to Navigation
Poster communications

From Phonemes to Sentence Comprehension: A Neurocomputational Model of Sentence Processing for Robots

Xavier Hinaut 1 
1 Mnemosyne - Mnemonic Synergy
LaBRI - Laboratoire Bordelais de Recherche en Informatique, Inria Bordeaux - Sud-Ouest, IMN - Institut des Maladies Neurodégénératives [Bordeaux]
Abstract : There has been an important progress these last years in speech recognition systems. The word recognition error rate went down with the arrival of deep learning methods. However, if one uses cloud speech API and integrate it inside a robotic architecture, one faces a non negligible number of wrong sentence recognition. Thus speech recognition can not be considered as solved (because many sentences out of their contexts are ambiguous). We believe that contextual solutions (i.e. adaptable and trainable on different HRI applications) have to be found. In this perspective, the way children learn language and how our brains process utterances may help us improve how robots process language. Getting inspiration from language acquisition theories and how the brain processes sentences we previously developed a neuro-inspired model of sentence processing. In this study, we investigate how this model can process different levels of abstractions as input: sequence of phonemes, seq. of words or grammatical constructions. We see that even if the model was only tested on grammatical constructions before, it has better performances with words and phonemes inputs.
Complete list of metadata

Cited literature [12 references]  Display  Hide  Download
Contributor : Xavier Hinaut Connect in order to contact the contributor
Submitted on : Thursday, January 3, 2019 - 11:17:04 AM
Last modification on : Saturday, June 25, 2022 - 10:38:48 AM
Long-term archiving on: : Thursday, April 4, 2019 - 1:21:07 PM


Files produced by the author(s)


  • HAL Id : hal-01964524, version 1



Xavier Hinaut. From Phonemes to Sentence Comprehension: A Neurocomputational Model of Sentence Processing for Robots. SBDM2018 Satellite-Workshop on interfaces between Robotics, Artificial Intelligence and Neuroscience, May 2018, Paris, France. ⟨hal-01964524⟩



Record views


Files downloads