Track and Cut: simultaneous tracking and segmentation of multiple objects with graph cuts

Aurelie Bugeau 1 Patrick Perez 1
1 VISTA - Vision spatio-temporelle et active
IRISA - Institut de Recherche en Informatique et Systèmes Aléatoires, Inria Rennes – Bretagne Atlantique
Abstract : This paper presents a new method to both track and segment multiple objects in videos using min-cut/max-flow optimizations. We introduce objective functions that combine low-level pixel-wise measures (color, motion), high-level observations obtained via an independent detection module, motion prediction and contrast-sensitive contextual regularization. One novelty is that external observations are used without adding any association step. The observations are image regions (pixel sets) that can be output by any kind of detector. The minimization of these cost functions simultaneously allows "detection-before-track" tracking (track-to-observation assignment and automatic initialization of new tracks) and segmentation of tracked objects. When several tracked objects get mixed up by the detection module (e.g., single foreground detection mask for objects close to each other), a second stage of minimization allows the proper tracking and segmentation of these individual entities despite the observation confusion. Experiments on different type of sequences demonstrate the ability of the method to detect, track and precisely segment persons as they enter and traverse the field of view, even in cases of partial occlusions, temporary grouping and frame dropping.
Type de document :
Rapport
[Research Report] RR-6337, INRIA. 2007, pp.23
Liste complète des métadonnées

Littérature citée [40 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/inria-00181865
Contributeur : Aurelie Bugeau <>
Soumis le : lundi 29 octobre 2007 - 11:17:35
Dernière modification le : jeudi 11 janvier 2018 - 06:20:11
Document(s) archivé(s) le : jeudi 23 septembre 2010 - 16:12:11

Fichiers

RR_suivi.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : inria-00181865, version 3

Collections

Citation

Aurelie Bugeau, Patrick Perez. Track and Cut: simultaneous tracking and segmentation of multiple objects with graph cuts. [Research Report] RR-6337, INRIA. 2007, pp.23. 〈inria-00181865v3〉

Partager

Métriques

Consultations de la notice

239

Téléchargements de fichiers

201