Proposal Flow: Semantic Correspondences from Object Proposals

Abstract : Finding image correspondences remains a challenging problem in the presence of intra-class variations and large changes in scene layout. Semantic flow methods are designed to handle images depicting different instances of the same object or scene category. We introduce a novel approach to semantic flow, dubbed proposal flow, that establishes reliable correspondences using object proposals. Unlike prevailing semantic flow approaches that operate on pixels or regularly sampled local regions, proposal flow benefits from the characteristics of modern object proposals, that exhibit high repeatability at multiple scales, and can take advantage of both local and geometric consistency constraints among proposals. We also show that the corresponding sparse proposal flow can effectively be transformed into a conventional dense flow field. We introduce two new challenging datasets that can be used to evaluate both general semantic flow techniques and region-based approaches such as proposal flow. We use these benchmarks to compare different matching algorithms, object proposals, and region features within proposal flow, to the state of the art in semantic flow. This comparison, along with experiments on standard datasets, demonstrates that proposal flow significantly outperforms existing semantic flow methods in various settings.
Type de document :
Article dans une revue
IEEE Transactions on Pattern Analysis and Machine Intelligence, Institute of Electrical and Electronics Engineers, A Paraître
Liste complète des métadonnées

Littérature citée [82 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01644132
Contributeur : Bumsub Ham <>
Soumis le : mercredi 22 novembre 2017 - 03:13:15
Dernière modification le : mercredi 29 novembre 2017 - 15:18:04

Fichier

proposal_flow_revised.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01644132, version 1

Collections

UGA | INRIA | PSL | LJK

Citation

Bumsub Ham, Minsu Cho, Cordelia Schmid, Jean Ponce. Proposal Flow: Semantic Correspondences from Object Proposals. IEEE Transactions on Pattern Analysis and Machine Intelligence, Institute of Electrical and Electronics Engineers, A Paraître. 〈hal-01644132〉

Partager

Métriques

Consultations de la notice

92

Téléchargements de fichiers

34