Skip to Main content Skip to Navigation
Conference papers

Multichannel Recurrent Kernel Machines for Robot Episodic-Semantic Map Building

Abstract : For humans to understand the world around them, multimodal integration is essential because it enhances perceptual precision and reduces ambiguity. Computational models repli-cating such human ability may contribute to the practical use of robots in daily human living environments In this paper, we propose Multichannel Recurrent Kernel Machines (MC-RKM) for continuously generating a topological semantic map from multiple sensors. The proposed method consists of two hierarchical memory layers: i) Episodic Memory and ii) Semantic Memory layer. Each layer consists of one or more than one Infinite Echo State Network with a different learning task. The Episodic Memory layer incrementally clusters incoming sensory data as nodes and learns fine-grained spatiotemporal relationships of them. The Episodic Memory layer learning is in an unsupervised manner. The Semantic Memory layer utilizes task-relevant cues to adjust the level of architectural flexibility and generate a topological semantic map that contains more compact episodic representations. The generated topological semantic map represents the memory of the robot in which it is used for robot path planning and navigation.
Complete list of metadata

Cited literature [9 references]  Display  Hide  Download
Contributor : Xavier Hinaut Connect in order to contact the contributor
Submitted on : Wednesday, October 28, 2020 - 7:59:50 PM
Last modification on : Friday, November 6, 2020 - 12:12:06 PM
Long-term archiving on: : Friday, January 29, 2021 - 7:30:34 PM


Files produced by the author(s)


  • HAL Id : hal-02982754, version 1



Wei Hong Chin, Chu Kiong Loo, Stefan Wermter. Multichannel Recurrent Kernel Machines for Robot Episodic-Semantic Map Building. 1st SMILES (Sensorimotor Interaction, Language and Embodiment of Symbols) workshop, ICDL 2020, Nov 2020, Valparaiso, Chile. ⟨hal-02982754⟩



Record views


Files downloads