HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation
Conference papers

Finding Actors and Actions in Movies

Piotr Bojanowski 1, 2 Francis Bach 1, 3 Ivan Laptev 1, 2 Jean Ponce 1, 2 Cordelia Schmid 4 Josef Sivic 1, 2
2 WILLOW - Models of visual object recognition and scene understanding
CNRS - Centre National de la Recherche Scientifique : UMR8548, Inria Paris-Rocquencourt, DI-ENS - Département d'informatique - ENS Paris
3 SIERRA - Statistical Machine Learning and Parsimony
DI-ENS - Département d'informatique - ENS Paris, Inria Paris-Rocquencourt, CNRS - Centre National de la Recherche Scientifique : UMR8548
4 LEAR - Learning and recognition in vision
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, Grenoble INP - Institut polytechnique de Grenoble - Grenoble Institute of Technology
Abstract : We address the problem of learning a joint model of actors and actions in movies using weak supervision provided by scripts. Specifically, we extract actor/action pairs from the script and use them as constraints in a discriminative clustering framework. The corresponding optimization problem is formulated as a quadratic program under linear constraints. People in video are represented by automatically extracted and tracked faces together with corresponding motion features. First, we apply the proposed framework to the task of learning names of characters in the movie and demonstrate significant improvements over previous methods used for this task. Second, we explore the joint actor/action constraint and show its advantage for weakly supervised action learning. We validate our method in the challenging setting of localizing and recognizing characters and their actions in feature length movies Casablanca and American Beauty.
Document type :
Conference papers
Complete list of metadata

Cited literature [25 references]  Display  Hide  Download

https://hal.inria.fr/hal-00904991
Contributor : Piotr Bojanowski Connect in order to contact the contributor
Submitted on : Friday, November 15, 2013 - 4:26:19 PM
Last modification on : Thursday, March 17, 2022 - 10:08:43 AM
Long-term archiving on: : Monday, February 17, 2014 - 4:46:01 PM

File

joint_learning_names.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Piotr Bojanowski, Francis Bach, Ivan Laptev, Jean Ponce, Cordelia Schmid, et al.. Finding Actors and Actions in Movies. ICCV 2013 - IEEE International Conference on Computer Vision, Dec 2013, Sydney, Australia. pp.2280-2287, ⟨10.1109/ICCV.2013.283⟩. ⟨hal-00904991⟩

Share

Metrics

Record views

741

Files downloads

576