Weakly supervised learning of interactions between humans and objects - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Rapport (Rapport Technique) Année : 2010

Weakly supervised learning of interactions between humans and objects

Résumé

We introduce a weakly supervised approach for learning human actions modeled as interactions between humans and objects. Our approach is human-centric: we first localize a human in the image and then determine the object relevant for the action and its spatial relation with the human. The model is learned automatically from a set of still images annotated (only) with the action label. Our approach relies on a human detector to initialize the model learning. For robustness to various degrees of visibility, we build a detector that learns to combine a set of existing part detectors. Starting from humans detected in a set of images depicting the action, our approach determines the action object and its spatial relation to the human. Its final output is a probabilistic model of the human-object interaction, i.e. the spatial relation between the human and the object.
Fichier principal
Vignette du fichier
RT-0391.pdf (3.43 Mo) Télécharger le fichier
Vignette du fichier
Screenshot.png (263.69 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Format : Figure, Image
Loading...

Dates et versions

inria-00516477 , version 1 (09-09-2010)

Identifiants

  • HAL Id : inria-00516477 , version 1

Citer

Alessandro Prest, Cordelia Schmid, Vittorio Ferrari. Weakly supervised learning of interactions between humans and objects. [Technical Report] RT-391, INRIA. 2010. ⟨inria-00516477⟩
334 Consultations
354 Téléchargements

Partager

Gmail Facebook X LinkedIn More