Orientation covariant aggregation of local descriptors with embeddings

Giorgos Tolias; Teddy Furon; Hervé Jégou

Communication Dans Un Congrès Année : 2014

Orientation covariant aggregation of local descriptors with embeddings

(1) , (1) , (1)

Giorgos Tolias

Fonction : Auteur correspondant
PersonId : 3776
IdHAL : giorgos-tolias
IdRef : 035762616

Connectez-vous pour contacter l'auteur

Multimedia content-based indexing

Teddy Furon

Fonction : Auteur
PersonId : 3087
IdHAL : teddy-furon
IdRef : 078044758

Multimedia content-based indexing

Hervé Jégou

Fonction : Auteur
PersonId : 833473

Multimedia content-based indexing

Résumé

Image search systems based on local descriptors typically achieve orientation invariance by aligning the patches on their dominant orientations. Albeit successful, this choice introduces too much invariance because it does not guarantee that the patches are rotated consistently. This paper introduces an aggregation strategy of local descriptors that achieves this covariance property by jointly encoding the angle in the aggregation stage in a continuous manner. It is combined with an efficient monomial embedding to provide a codebook-free method to aggregate local descriptors into a single vector representation. Our strategy is also compatible and employed with several popular encoding methods, in particular bag-of-words, VLAD and the Fisher vector. Our geometric-aware aggregation strategy is effective for image search, as shown by experiments performed on standard benchmarks for image and particular object retrieval, namely Holidays and Oxford buildings.

Mots clés

image search orientation covariant descriptor aggregation

Domaines

Vision par ordinateur et reconnaissance de formes [cs.CV]

Fichier principal

eccv14_tolias_orientation_covariant_aggregation.pdf (1.02 Mo)

angemb.png (6.27 Ko)

K_vm.pdf (36.87 Ko)

K_vm_2approx.pdf (6.76 Ko)

K_vm_32approx.pdf (6 Ko)

K_vm_8approx.pdf (5.82 Ko)

frequencies.pdf (3.16 Ko)

map_vs_dim_holidays.pdf (3.24 Ko)

map_vs_dim_oxford5k.pdf (3.21 Ko)

match_176_179_6_a.pdf (216.6 Ko)

match_176_179_6_d.pdf (216.66 Ko)

match_176_179_6_m.pdf (216.59 Ko)

mod_effect_fisher_holidays.pdf (3.13 Ko)

mod_effect_vlad_holidays.pdf (3.13 Ko)

rotation_stats_org1.pdf (5.62 Ko)

rotation_stats_org2.pdf (5.5 Ko)

rotation_stats_org3.pdf (5.55 Ko)

rotation_stats_org4.pdf (5.32 Ko)

rotation_stats_org5.pdf (5.54 Ko)

rotation_stats_org6.pdf (5.54 Ko)

rotation_stats_org7.pdf (5.54 Ko)

rotation_stats_org8.pdf (5.54 Ko)

rotation_stats_weighted1.pdf (2.07 Ko)

rotation_stats_weighted2.pdf (2.16 Ko)

rotation_stats_weighted3.pdf (3.11 Ko)

rotation_stats_weighted4.pdf (4.72 Ko)

rotation_stats_weighted5.pdf (4.69 Ko)

rotation_stats_weighted6.pdf (3.11 Ko)

rotation_stats_weighted7.pdf (2.16 Ko)

rotation_stats_weighted8.pdf (2.07 Ko)

vm_kappa_holidays.pdf (3.55 Ko)

Origine : Fichiers produits par l'(les) auteur(s)

Format : Figure, Image
Origine : Fichiers produits par l'(les) auteur(s)

Origine : Fichiers produits par l'(les) auteur(s)

Giorgos Tolias : Connectez-vous pour contacter le contributeur

https://inria.hal.science/hal-01020823

Soumis le : vendredi 21 novembre 2014-15:23:27

Dernière modification le : vendredi 24 mars 2023-14:52:59

Archivage à long terme le : vendredi 14 avril 2017-19:24:42

Dates et versions

hal-01020823 , version 1 (08-07-2014)

hal-01020823 , version 2 (21-11-2014)

hal-01020823 , version 3 (25-11-2014)

Identifiants

HAL Id : hal-01020823 , version 2
ARXIV : 1407.2170

Citer

Giorgos Tolias, Teddy Furon, Hervé Jégou. Orientation covariant aggregation of local descriptors with embeddings. European Conference on Computer Vision, Sep 2014, Zurich, Switzerland. ⟨hal-01020823v2⟩

Exporter

BibTeX XML-TEI Dublin Core DC Terms EndNote DataCite

326 Consultations

1128 Téléchargements

Orientation covariant aggregation of local descriptors with embeddings

Résumé

Mots clés

Domaines

Dates et versions

Identifiants

Citer

Exporter

Altmetric

Partager