Eye-tracking data analysis using hidden semi-Markovian models to identify and characterize reading strategies

Brice Olivier 1 Jean-Baptiste Durand 1 Anne Guérin-Dugué 2 Marianne Clausel 3
1 MISTIS - Modelling and Inference of Complex and Structured Stochastic Systems
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
2 GIPSA-VIBS - VIBS
GIPSA-DIS - Département Images et Signal
3 DAO - Données, Apprentissage et Optimisation
LJK - Laboratoire Jean Kuntzmann
Abstract : Textual information search is not a homogeneous process in time, neither from a cognitive perspective nor in terms of eye-movement patterns (Simola, 2008). The research objective is to analyze eye-tracking signals acquired through participants achieving a reading task and simultaneously aiming at making a binary decision: whether a text is related or not to some theme given a priori. This activity is expected to involve several phases with contrasted oculometric characteristics, such as normal reading, scanning, careful reading, associated with different cognitive strategies, such as creation and rejection of hypotheses, confirmation and decision. We propose an analytical data-driven method based on hidden semi-Markov models (Yu, 2010) which are composed of two stochastic processes. The former is observed, and corresponds to eye-movement features over time, while the latter is a latent semi-Markov chain, which preconditions the first process, and is used to uncover the information acquisition strategies. Four interpretable strategies were highlighted: normal reading, fast reading, careful reading, and decision making. This interpretation was derived using the model properties such as dwell times, inter-phase transition probabilities, and emission probabilities, which characterize the observed process. More importantly, model selection was performed using both, information theory criterion and some covariates, which were also used to reinforce the interpretation.
Type de document :
Communication dans un congrès
European Conference on Eye Movements - ECEM 2017 , Aug 2017, Wuppertal, Germany. 2017, 〈http://ecem2017.uni-wuppertal.de/〉
Liste complète des métadonnées

https://hal.inria.fr/hal-01671224
Contributeur : Jean-Baptiste Durand <>
Soumis le : vendredi 22 décembre 2017 - 10:38:24
Dernière modification le : lundi 30 avril 2018 - 15:02:01

Identifiants

  • HAL Id : hal-01671224, version 1

Citation

Brice Olivier, Jean-Baptiste Durand, Anne Guérin-Dugué, Marianne Clausel. Eye-tracking data analysis using hidden semi-Markovian models to identify and characterize reading strategies. European Conference on Eye Movements - ECEM 2017 , Aug 2017, Wuppertal, Germany. 2017, 〈http://ecem2017.uni-wuppertal.de/〉. 〈hal-01671224〉

Partager

Métriques

Consultations de la notice

248