Inverse Reinforcement Learning algorithms and features for robot navigation in crowds: An experimental comparison

Dizan Vasquez 1 Billy Okal 2 Kai Arras 2
1 E-MOTION - Geometry and Probability for Motion and Action
Inria Grenoble - Rhône-Alpes, LIG - Laboratoire d'Informatique de Grenoble
2 Albert-Ludwigs University
Abstract : — For mobile robots which operate in human pop-ulated environments, modeling social interactions is key to understand and reproduce people's behavior. A promising approach to this end is Inverse Reinforcement Learning (IRL) as it allows to model the factors that motivate people's actions instead of the actions themselves. A crucial design choice in IRL is the selection of features that encode the agent's context. In related work, features are typically chosen ad hoc without systematic evaluation of the alternatives and their actual impact on the robot's task. In this paper, we introduce a new software framework to systematically investigate the effect features and learning algorithms used in the literature. We also present results for the task of socially compliant robot navigation in crowds, evaluating two different IRL approaches and several feature sets in large-scale simulations. The results are benchmarked according to a proposed set of objective and subjective performance metrics.
Document type :
Conference papers
Complete list of metadatas

Cited literature [21 references]  Display  Hide  Download
https://hal.inria.fr/hal-01105265
Contributor : Dizan Vasquez <>
Submitted on : Tuesday, January 20, 2015 - 10:01:27 AM
Last modification on : Thursday, October 11, 2018 - 8:48:02 AM
Long-term archiving on : Friday, September 11, 2015 - 7:40:18 AM

File

iros14.pdf
Files produced by the author(s)

Identifiers

Collections

INRIA | LIG_SRCPR | LIG_SIC_E-MOTION | LIG | UGA

Citation

Dizan Vasquez, Billy Okal, Kai Arras. Inverse Reinforcement Learning algorithms and features for robot navigation in crowds: An experimental comparison. IEEE-RSJ Int. Conf. on Intelligent Robots and Systems, 2014, Chicago, United States. pp.1341 - 1346, ⟨10.1109/IROS.2014.6942731⟩. ⟨hal-01105265⟩

Export

BibTeX TEI DC DCterms EndNote

Share

Metrics

Record views

370

Files downloads

1475

Contact


archive-ouverte@inria.fr