Skip to Main content Skip to Navigation
Conference papers

Predicting Actions from Static Scenes

Tuan-Hung Vu 1 Catherine Olsson 2 Ivan Laptev 1 Aude Oliva 2 Josef Sivic 1
1 WILLOW - Models of visual object recognition and scene understanding
DI-ENS - Département d'informatique de l'École normale supérieure, Inria Paris-Rocquencourt, CNRS - Centre National de la Recherche Scientifique : UMR8548
Abstract : Human actions naturally co-occur with scenes. In this work we aim to discover action-scene correlation for a large number of scene categories and to use such correlation for action prediction. Towards this goal, we collect a new SUN Action dataset with manual annotations of typical human actions for 397 scenes. We next discover action-scene associations and demonstrate that scene categories can be well identified from their associated actions. Using discovered associations, we address a new task of predicting human actions for images of static scenes. We evaluate prediction of 23 and 38 action classes for images of indoor and outdoor scenes respectively and show promising results. We also propose a new application of geo-localized action prediction and demonstrate ability of our method to automatically answer queries such as "Where is a good place for a picnic?" or "Can I cycle along this path?".
Document type :
Conference papers
Complete list of metadata

Cited literature [28 references]  Display  Hide  Download

https://hal.inria.fr/hal-01053935
Contributor : Tuan-Hung Vu <>
Submitted on : Monday, August 25, 2014 - 5:12:27 PM
Last modification on : Thursday, July 1, 2021 - 5:58:07 PM
Long-term archiving on: : Tuesday, April 11, 2017 - 7:11:46 PM

File

eccv14_actionsfromscenes.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Tuan-Hung Vu, Catherine Olsson, Ivan Laptev, Aude Oliva, Josef Sivic. Predicting Actions from Static Scenes. ECCV'14 - 13th European Conference on Computer Vision, Sep 2014, Zurich, Switzerland. pp.421-436, ⟨10.1007/978-3-319-10602-1_28⟩. ⟨hal-01053935⟩

Share

Metrics

Record views

426

Files downloads

1398