Select or Suggest? Reinforcement Learning-based Method for High-Accuracy Target Selection on Touchscreens - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2022

Select or Suggest? Reinforcement Learning-based Method for High-Accuracy Target Selection on Touchscreens

Zhi Li
  • Fonction : Auteur
  • PersonId : 1105593
Maozheng Zhao
  • Fonction : Auteur
  • PersonId : 1105594
Dibyendu Das
  • Fonction : Auteur
  • PersonId : 1134233
Hang Zhao
  • Fonction : Auteur
  • PersonId : 1134234
Yan Ma
  • Fonction : Auteur
  • PersonId : 1134235
Fusheng Wang
  • Fonction : Auteur
  • PersonId : 1105600
Xiaojun Bi
  • Fonction : Auteur
  • PersonId : 1026272

Résumé

Suggesting multiple target candidates based on touch input is a possible option for high-accuracy target selection on small touchscreen devices. But it can become overwhelming if suggestions are triggered too often. To address this, we propose SATS, a Suggestionbased Accurate Target Selection method, where target selection is formulated as a sequential decision problem. The objective is to maximize the utility: the negative time cost for the entire target selection procedure. The SATS decision process is dictated by a policy generated using reinforcement learning. It automatically decides when to provide suggestions and when to directly select the target. Our user studies show that SATS reduced error rate and selection time over Shift [51], a magnification-based method, and MUCS, a suggestion-based alternative that optimizes the utility for the current selection. SATS also significantly reduced error rate over BayesianCommand [58], which directly selects targets based on posteriors, with only a minor increase in selection time.
Fichier principal
Vignette du fichier
RLforTouchTargetSelection-CHI22-authorversion.pdf (1.81 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03664185 , version 1 (10-05-2022)

Identifiants

Citer

Zhi Li, Maozheng Zhao, Dibyendu Das, Hang Zhao, Yan Ma, et al.. Select or Suggest? Reinforcement Learning-based Method for High-Accuracy Target Selection on Touchscreens. CHI 2022 - ACM Conference on Human Factors in Computing Systems, Apr 2022, New Orleans, LA, United States. pp.1-15, ⟨10.1145/3491102.3517472⟩. ⟨hal-03664185⟩
72 Consultations
155 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More