Semantic Role Labelling for Robot Instructions using Echo State Networks

Johannes Twiefel 1 Xavier Hinaut 2, 1 Stefan Wermter 1
1 KT - Knowledge Technology group [Hamburg]
Department of Informatics [Hamburg]
2 Mnemosyne - Mnemonic Synergy
LaBRI - Laboratoire Bordelais de Recherche en Informatique, Inria Bordeaux - Sud-Ouest, IMN - Institut des Maladies Neurodégénératives [Bordeaux]
Abstract : To control a robot in a real-world robot scenario, a real-time parser is needed to create semantic representations from natural language which can be interpreted. The parser should be able to create the hierarchical tree-like representations without consulting external systems to show its learning capabilities. We propose an efficient Echo State Network-based parser for robotic commands and only relies on the training data. The system generates a single semantic tree structure in real-time which can be executed by a robot arm manipulating objects. Four of six other approaches, which in most cases generate multiple trees and select one of them as the solution, were outperformed with 64.2% tree accuracy on difficult unseen natural language (74.1% under best conditions) on the same dataset.
Document type :
Conference papers
Complete list of metadatas

Cited literature [18 references]  Display  Hide  Download
https://hal.inria.fr/hal-01417701
Contributor : Xavier Hinaut <>
Submitted on : Thursday, December 15, 2016 - 7:00:32 PM
Last modification on : Thursday, February 7, 2019 - 4:47:01 PM

File

Twiefel_ESANN_2016_camera_read...
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01417701, version 1

Collections

INRIA-BORDEAUX | UNIV-BORDEAUX | LABRI | INRIA

Citation

Johannes Twiefel, Xavier Hinaut, Stefan Wermter. Semantic Role Labelling for Robot Instructions using Echo State Networks. European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning (ESANN), Apr 2016, Bruges, Belgium. ⟨hal-01417701⟩

Export

BibTeX TEI DC DCterms EndNote

Share

Metrics

Record views

523

Files downloads

279

Contact


archive-ouverte@inria.fr