Skip to Main content Skip to Navigation
Conference papers

Learning User Preferences in Ubiquitous Systems: A User Study and a Reinforcement Learning Approach

Sofia Zaidenberg 1 Patrick Reignier 2 Nadine Mandran 3
1 STARS - Spatio-Temporal Activity Recognition Systems
CRISAM - Inria Sophia Antipolis - Méditerranée
2 PRIMA - Perception, recognition and integration for observation of activity
Inria Grenoble - Rhône-Alpes, UJF - Université Joseph Fourier - Grenoble 1, INPG - Institut National Polytechnique de Grenoble , CNRS - Centre National de la Recherche Scientifique : UMR5217
Abstract : Our study concerns a virtual assistant, proposing services to the user based on its current perceived activity and situation (ambient intelligence). Instead of asking the user to define his preferences, we acquire them automatically using a reinforcement learning approach. Experiments showed that our system succeeded the learning of user preferences. In order to validate the relevance and usability of such a system, we have first conducted a user study. 26 non-expert subjects were interviewed using a model of the final system. This paper presents the methodology of applying reinforcement learning to a real-world problem with experimental results and the conclusions of the user study.
Document type :
Conference papers
Complete list of metadata

Cited literature [21 references]  Display  Hide  Download
Contributor : Sofia Zaidenberg Connect in order to contact the contributor
Submitted on : Wednesday, February 13, 2013 - 4:16:52 PM
Last modification on : Thursday, October 21, 2021 - 3:47:56 AM
Long-term archiving on: : Tuesday, May 14, 2013 - 4:02:50 AM


Files produced by the author(s)



Sofia Zaidenberg, Patrick Reignier, Nadine Mandran. Learning User Preferences in Ubiquitous Systems: A User Study and a Reinforcement Learning Approach. Artificial Intelligence Applications and Innovations, Harris Papadopoulos and Andreas S. Andreou and Max Bramer, Oct 2010, Larnaca, Cyprus. pp.336-343, ⟨10.1007/978-3-642-16239-8_44⟩. ⟨hal-00788028⟩



Les métriques sont temporairement indisponibles