Joint Future Semantic and Instance Segmentation Prediction - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2018

Joint Future Semantic and Instance Segmentation Prediction

Camille Couprie
  • Fonction : Auteur
  • PersonId : 880568
Pauline Luc
  • Fonction : Auteur
  • PersonId : 14827
  • IdHAL : pauline-luc

Résumé

The ability to predict what will happen next from observing the past is a key component of intelligence. Methods that forecast future frames were recently introduced towards better machine intelligence. However, predicting directly in the image color space seems an overly complex task, and predicting higher level representations using semantic or instance segmentation approaches were shown to be more accurate. In this work, we introduce a novel prediction approach that encodes instance and semantic segmentation information in a single representation based on distance maps. Our graph-based modeling of the instance segmentation prediction problem allows us to obtain temporal tracks of the objects as an optimal solution to a watershed algorithm. Our experimental results on the Cityscapes dataset present state-of-the-art semantic segmentation predictions, and instance segmentation results outperforming a strong baseline based on optical flow.
Fichier principal
Vignette du fichier
couprie18eccvw.pdf (28.97 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01867746 , version 1 (04-09-2018)

Identifiants

Citer

Camille Couprie, Pauline Luc, Jakob Verbeek. Joint Future Semantic and Instance Segmentation Prediction. ECCV Workshop on Anticipating Human Behavior, Sep 2018, Munich, Germany. pp.154-168, ⟨10.1007/978-3-030-11015-4_14⟩. ⟨hal-01867746⟩
281 Consultations
430 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More