REINFORCED LEARNING OF CONTEXT MODELS FOR UBIQUITOUS COMPUTING. Application to a ubiquitous personal assistant

Sofia Zaidenberg 1 Patrick Reignier 1 James L. Crowley 1
1 PRIMA - Perception, recognition and integration for observation of activity
Inria Grenoble - Rhône-Alpes, UJF - Université Joseph Fourier - Grenoble 1, INPG - Institut National Polytechnique de Grenoble , CNRS - Centre National de la Recherche Scientifique : UMR5217
Abstract : Ubiquitous environments may become a reality in a foreseeable future and research is aimed on making them more and more adapted and comfortable for users. Our work consists on applying reinforcement learning techniques in order to adapt services provided by a ubiquitous assistant to the user. The learning produces a context model, associating actions to perceived situations of the user. Associations are based on feedback given by the user as a reaction to the behavior of the assistant. Our method brings a solution to some of the problems encountered when applying reinforcement learning to systems where the user is in the loop. For instance, the behavior of the system is completely incoherent at the beginning and needs time to converge. The user does not accept to wait that long to train the system. The user's habits may change over time and the assistant needs to integrate these changes quickly. We study methods to accelerate the reinforced learning process.
Keywords : Reinforced learning context models ubiquitous computing intelligent agent virtual assistant services task delegation auto-adaptative system
Type de document :
Communication dans un congrès
Jorge Cardoso. 6th ICEIS Doctoral Consortium - DCEIS 2008, Jun 2008, Barcelone, Spain. INSTICC Press, 6, pp.36-48, 2008, Proceedings of the 6th ICEIS Doctoral Consortium - DCEIS 2008
Liste complète des métadonnées

Littérature citée [19 références]  Voir  Masquer  Télécharger
https://hal.inria.fr/hal-00788064
Contributeur : Sofia Zaidenberg <>
Soumis le : mercredi 13 février 2013 - 16:12:56
Dernière modification le : mercredi 11 avril 2018 - 01:56:22
Document(s) archivé(s) le : mardi 14 mai 2013 - 04:03:11

Fichier

Zaidenberg_DCICEIS2008.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-00788064, version 1

Collections

INRIA | LIG_SIC | LIG | LIG_SIC_PRIMA | UGA

Citation

Sofia Zaidenberg, Patrick Reignier, James L. Crowley. REINFORCED LEARNING OF CONTEXT MODELS FOR UBIQUITOUS COMPUTING. Application to a ubiquitous personal assistant. Jorge Cardoso. 6th ICEIS Doctoral Consortium - DCEIS 2008, Jun 2008, Barcelone, Spain. INSTICC Press, 6, pp.36-48, 2008, Proceedings of the 6th ICEIS Doctoral Consortium - DCEIS 2008. 〈hal-00788064〉

Exporter

BibTeX TEI DC DCterms EndNote

Partager

Métriques

Consultations de la notice

267

Téléchargements de fichiers

97

Contact


archive-ouverte@inria.fr