Deep learning investigation for chess player attention prediction using eye-tracking and game data

Justin Le Louedec 1 Thomas Guntz 1 James L. Crowley 1 Dominique Vaufreydaz 1
1 PERVASIVE - Interaction située avec les objets et environnements intelligents
Inria Grenoble - Rhône-Alpes, LIG - Laboratoire d'Informatique de Grenoble, Grenoble INP - Institut polytechnique de Grenoble - Grenoble Institute of Technology, UGA - Université Grenoble Alpes
Abstract : This article reports on an investigation of the use of convolutional neural networks to predict the visual attention of chess players. The visual attention model described in this article has been created to generate saliency maps that capture hierarchical and spatial features of chessboard, in order to predict the probability fixation for individual pixels Using a skip-layer architecture of an autoencoder, with a unified decoder, we are able to use multiscale features to predict saliency of part of the board at different scales, showing multiple relations between pieces. We have used scan path and fixation data from players engaged in solving chess problems, to compute 6600 saliency maps associated to the corresponding chess piece configurations. This corpus is completed with synthetically generated data from actual games gathered from an online chess platform. Experiments realized using both scan-paths from chess players and the CAT2000 saliency dataset of natural images, highlights several results. Deep features, pretrained on natural images, were found to be helpful in training visual attention prediction for chess. The proposed neural network architecture is able to generate meaningful saliency maps on unseen chess configurations with good scores on standard metrics. This work provides a baseline for future work on visual attention prediction in similar contexts.
Complete list of metadatas
Contributor : Dominique Vaufreydaz <>
Submitted on : Monday, April 15, 2019 - 6:37:25 PM
Last modification on : Thursday, May 2, 2019 - 3:16:02 PM


Files produced by the author(s)




Justin Le Louedec, Thomas Guntz, James L. Crowley, Dominique Vaufreydaz. Deep learning investigation for chess player attention prediction using eye-tracking and game data. ETRA 2019 - ACM Symposium On Eye Tracking Research & Applications, Jun 2019, Denver, United States. pp.1-15, ⟨10.1145/3314111.3319827⟩. ⟨hal-02100389⟩



Record views


Files downloads