HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation
Conference papers

Semantic Role Labelling for Robot Instructions using Echo State Networks

Johannes Twiefel 1 Xavier Hinaut 2, 1 Stefan Wermter 1
1 KT - Knowledge Technology group [Hamburg]
Department of Informatics [Hamburg]
2 Mnemosyne - Mnemonic Synergy
LaBRI - Laboratoire Bordelais de Recherche en Informatique, Inria Bordeaux - Sud-Ouest, IMN - Institut des Maladies Neurodégénératives [Bordeaux]
Abstract : To control a robot in a real-world robot scenario, a real-time parser is needed to create semantic representations from natural language which can be interpreted. The parser should be able to create the hierarchical tree-like representations without consulting external systems to show its learning capabilities. We propose an efficient Echo State Network-based parser for robotic commands and only relies on the training data. The system generates a single semantic tree structure in real-time which can be executed by a robot arm manipulating objects. Four of six other approaches, which in most cases generate multiple trees and select one of them as the solution, were outperformed with 64.2% tree accuracy on difficult unseen natural language (74.1% under best conditions) on the same dataset.
Complete list of metadata

Cited literature [18 references]  Display  Hide  Download

Contributor : Xavier Hinaut Connect in order to contact the contributor
Submitted on : Thursday, December 15, 2016 - 7:00:32 PM
Last modification on : Monday, December 20, 2021 - 4:50:15 PM


Files produced by the author(s)


  • HAL Id : hal-01417701, version 1



Johannes Twiefel, Xavier Hinaut, Stefan Wermter. Semantic Role Labelling for Robot Instructions using Echo State Networks. European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning (ESANN), Apr 2016, Bruges, Belgium. ⟨hal-01417701⟩



Record views


Files downloads