From Phonemes to Sentence Comprehension: A Neurocomputational Model of Sentence Processing for Robots

Xavier Hinaut 1
1 Mnemosyne - Mnemonic Synergy
LaBRI - Laboratoire Bordelais de Recherche en Informatique, Inria Bordeaux - Sud-Ouest, IMN - Institut des Maladies Neurodégénératives [Bordeaux]
Abstract : There has been an important progress these last years in speech recognition systems. The word recognition error rate went down with the arrival of deep learning methods. However, if one uses cloud speech API and integrate it inside a robotic architecture, one faces a non negligible number of wrong sentence recognition. Thus speech recognition can not be considered as solved (because many sentences out of their contexts are ambiguous). We believe that contextual solutions (i.e. adaptable and trainable on different HRI applications) have to be found. In this perspective, the way children learn language and how our brains process utterances may help us improve how robots process language. Getting inspiration from language acquisition theories and how the brain processes sentences we previously developed a neuro-inspired model of sentence processing. In this study, we investigate how this model can process different levels of abstractions as input: sequence of phonemes, seq. of words or grammatical constructions. We see that even if the model was only tested on grammatical constructions before, it has better performances with words and phonemes inputs.
Type de document :
Poster
SBDM2018 Satellite-Workshop on interfaces between Robotics, Artificial Intelligence and Neuroscience, May 2018, Paris, France
Liste complète des métadonnées

https://hal.inria.fr/hal-01964524
Contributeur : Xavier Hinaut <>
Soumis le : jeudi 3 janvier 2019 - 11:17:04
Dernière modification le : jeudi 7 février 2019 - 15:36:51

Fichier

2018-05_Paris_ws_neurorob-IA_0...
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01964524, version 1

Citation

Xavier Hinaut. From Phonemes to Sentence Comprehension: A Neurocomputational Model of Sentence Processing for Robots. SBDM2018 Satellite-Workshop on interfaces between Robotics, Artificial Intelligence and Neuroscience, May 2018, Paris, France. 〈hal-01964524〉

Partager

Métriques

Consultations de la notice

29

Téléchargements de fichiers

122