Visual attention saccadic models: taking into account global scene context and temporal aspects of gaze behaviour

Antoine Coutrot 1 Olivier Le Meur 2
2 Sirocco - Analysis representation, compression and communication of visual data
Inria Rennes – Bretagne Atlantique , IRISA-D5 - SIGNAUX ET IMAGES NUMÉRIQUES, ROBOTIQUE
Abstract : Over the last 20 years, nearly 100 different saliency models have been proposed across a broad range of scientific communities. However, they remain quite limited when applied to natural scene exploration. Indeed, the vast majority of these models ignore two critical components of visual perception:(1) the global context of the visual scene, and (2) the sequential and time-varying aspects of overt attention. Here, we demonstrate that saccadic models allow overcoming these limitations. Saccadic models aim to predict the visual scanpath itself, i.e. the series of fixations and saccades an observer would perform to sample the visual environment. We trained our saccadic model with eye-tracking data from 6 datasets featuring different categories of visual content (static natural scenes, static webpages, dynamic landscapes and conversational videos). We show that, for a given visual category, our saccadic model tuned with the corresponding eye-tracking dataoutperforms well-established saliency models blind to visual scene semantic category. Moreover, our model provides scanpaths in close agreement with human behavior. This approach opens new avenues to tailor visual attention models for specific classes of visual stimuli or observer profiles.
Document type :
Poster communications
Complete list of metadatas

Cited literature [1 references]  Display  Hide  Download

https://hal.inria.fr/hal-01391751
Contributor : Olivier Le Meur <>
Submitted on : Friday, November 4, 2016 - 1:57:14 PM
Last modification on : Tuesday, November 5, 2019 - 1:34:01 PM
Long-term archiving on: Sunday, February 5, 2017 - 12:50:39 PM

File

Coutrot_ECVP2016_lowres.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01391751, version 1

Citation

Antoine Coutrot, Olivier Le Meur. Visual attention saccadic models: taking into account global scene context and temporal aspects of gaze behaviour. ECVP 2016 - European Conference on Visual Perception, Aug 2016, Barcelona, Spain. ⟨hal-01391751⟩

Share

Metrics

Record views

428

Files downloads

167