Towards Lifelong Object Learning by Integrating Situated Robot Perception and Semantic Web Mining

Abstract : Autonomous robots that are to assist humans in their daily lives are required, among other things, to recognize and understand the meaning of task-related objects. However, given an open-ended set of tasks, the set of everyday objects that robots will encounter during their lifetime is not foreseeable. That is, robots have to learn and extend their knowledge about previously unknown objects on-the-job. Our approach automatically acquires parts of this knowledge (e.g., the class of an object and its typical location) in form of ranked hypotheses from the Semantic Web using contextual information extracted from observations and experiences made by robots. Thus, by integrating situated robot perception and Semantic Web mining, robots can continuously extend their object knowledge beyond perceptual models which allows them to reason about task-related objects , e.g., when searching for them, robots can infer the most likely object locations. An evaluation of the integrated system on long-term data from real office observations, demonstrates that generated hypotheses can effectively constrain the meaning of objects. Hence, we believe that the proposed system can be an essential component in a lifelong learning framework which acquires knowledge about objects from real world observations.
Complete list of metadatas

Cited literature [22 references]  Display  Hide  Download
Contributor : Valerio Basile <>
Submitted on : Thursday, September 22, 2016 - 9:41:21 AM
Last modification on : Monday, November 5, 2018 - 3:52:09 PM


Files produced by the author(s)




Jay Young, Valerio Basile, Lars Kunze, Elena Cabrio, Nick Hawes. Towards Lifelong Object Learning by Integrating Situated Robot Perception and Semantic Web Mining. Proceedings of the European Conference on Artificial Intelligence (ECAI) 2016 conference, Aug 2016, THe Hague, Netherlands. ⟨10.3233/978-1-61499-672-9-1458⟩. ⟨hal-01370140⟩



Record views


Files downloads