Visual attention saccadic models: taking into account global scene context and temporal aspects of gaze behaviour

Antoine Coutrot 1 Olivier Le Meur 2
2 Sirocco - Analysis representation, compression and communication of visual data
IRISA-D5 - SIGNAUX ET IMAGES NUMÉRIQUES, ROBOTIQUE, Inria Rennes – Bretagne Atlantique
Abstract : Over the last 20 years, nearly 100 different saliency models have been proposed across a broad range of scientific communities. However, they remain quite limited when applied to natural scene exploration. Indeed, the vast majority of these models ignore two critical components of visual perception:(1) the global context of the visual scene, and (2) the sequential and time-varying aspects of overt attention. Here, we demonstrate that saccadic models allow overcoming these limitations. Saccadic models aim to predict the visual scanpath itself, i.e. the series of fixations and saccades an observer would perform to sample the visual environment. We trained our saccadic model with eye-tracking data from 6 datasets featuring different categories of visual content (static natural scenes, static webpages, dynamic landscapes and conversational videos). We show that, for a given visual category, our saccadic model tuned with the corresponding eye-tracking dataoutperforms well-established saliency models blind to visual scene semantic category. Moreover, our model provides scanpaths in close agreement with human behavior. This approach opens new avenues to tailor visual attention models for specific classes of visual stimuli or observer profiles.
Type de document :
Poster
ECVP 2016 - European Conference on Visual Perception, Aug 2016, Barcelona, Spain
Liste complète des métadonnées

Littérature citée [1 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01391751
Contributeur : Olivier Le Meur <>
Soumis le : vendredi 4 novembre 2016 - 13:57:14
Dernière modification le : mercredi 16 mai 2018 - 11:23:38
Document(s) archivé(s) le : dimanche 5 février 2017 - 12:50:39

Fichier

Coutrot_ECVP2016_lowres.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01391751, version 1

Citation

Antoine Coutrot, Olivier Le Meur. Visual attention saccadic models: taking into account global scene context and temporal aspects of gaze behaviour. ECVP 2016 - European Conference on Visual Perception, Aug 2016, Barcelona, Spain. 〈hal-01391751〉

Partager

Métriques

Consultations de la notice

355

Téléchargements de fichiers

139