Learning User Preferences in Ubiquitous Systems: A User Study and a Reinforcement Learning Approach

Sofia Zaidenberg 1 Patrick Reignier 2 Nadine Mandran 3
1 STARS - Spatio-Temporal Activity Recognition Systems
CRISAM - Inria Sophia Antipolis - Méditerranée
2 PRIMA - Perception, recognition and integration for observation of activity
Inria Grenoble - Rhône-Alpes, UJF - Université Joseph Fourier - Grenoble 1, INPG - Institut National Polytechnique de Grenoble , CNRS - Centre National de la Recherche Scientifique : UMR5217
3 LIG - Laboratoire d'Informatique de Grenoble
Abstract : Our study concerns a virtual assistant, proposing services to the user based on its current perceived activity and situation (ambient intelligence). Instead of asking the user to define his preferences, we acquire them automatically using a reinforcement learning approach. Experiments showed that our system succeeded the learning of user preferences. In order to validate the relevance and usability of such a system, we have first conducted a user study. 26 non-expert subjects were interviewed using a model of the final system. This paper presents the methodology of applying reinforcement learning to a real-world problem with experimental results and the conclusions of the user study.
Keywords : Ambient Intelligence Context-aware Computing Personnal Assistant Reinforcement Learning User Study
Type de document :
Communication dans un congrès
Harris Papadopoulos and Andreas S. Andreou and Max Bramer. Artificial Intelligence Applications and Innovations, Oct 2010, Larnaca, Cyprus. Springer, 339, pp.336-343, 2010, IFIP Advances in Information and Communication Technology. 〈10.1007/978-3-642-16239-8_44〉
Liste complète des métadonnées

Littérature citée [21 références]  Voir  Masquer  Télécharger
https://hal.inria.fr/hal-00788028
Contributeur : Sofia Zaidenberg <>
Soumis le : mercredi 13 février 2013 - 16:16:52
Dernière modification le : mercredi 11 avril 2018 - 01:54:44
Document(s) archivé(s) le : mardi 14 mai 2013 - 04:02:50

Fichier

Zaidenberg_AIAI2010.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Collections

INRIA | UGA | LIG_SIC_PRIMA | LIG_SIC | LIG | IFIP | IFIP-AICT | IFIP-AICT-339 | LIG_SRCPR | UNIV-COTEDAZUR

Citation

Sofia Zaidenberg, Patrick Reignier, Nadine Mandran. Learning User Preferences in Ubiquitous Systems: A User Study and a Reinforcement Learning Approach. Harris Papadopoulos and Andreas S. Andreou and Max Bramer. Artificial Intelligence Applications and Innovations, Oct 2010, Larnaca, Cyprus. Springer, 339, pp.336-343, 2010, IFIP Advances in Information and Communication Technology. 〈10.1007/978-3-642-16239-8_44〉. 〈hal-00788028〉

Exporter

BibTeX TEI DC DCterms EndNote

Partager

Métriques

Consultations de la notice

808

Téléchargements de fichiers

330

Contact


archive-ouverte@inria.fr