Generalizable Local Feature Pre-training for Deformable Shape Analysis - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

Generalizable Local Feature Pre-training for Deformable Shape Analysis

Résumé

Transfer learning is fundamental for addressing problems in settings with little training data. While several transfer learning approaches have been proposed in 3D, unfortunately, these solutions typically operate on an entire 3D object or even scene-level and thus, as we show, fail to generalize to new classes, such as deformable organic shapes. In addition, there is currently a lack of understanding of what makes pre-trained features transferable across significantly different 3D shape categories. In this paper, we make a step toward addressing these challenges. First, we analyze the link between feature locality and transferability in tasks involving deformable 3D objects, while also comparing different backbones and losses for local feature pre-training. We observe that with proper training, learned features can be useful in such tasks, but, crucially, only with an appropriate choice of the receptive field size. We then propose a differentiable method for optimizing the receptive field within 3D transfer learning. Jointly, this leads to the first learnable features that can successfully generalize to unseen classes of 3D shapes such as humans and animals. Our extensive experiments show that this approach leads to state-of-the-art results on several downstream tasks such as segmentation, shape correspondence, and classification. Our code is available at https://github.com/pvnieo/vader.

Domaines

Informatique
Fichier principal
Vignette du fichier
VADER_CVPR2023_cmp.pdf (2.64 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04352340 , version 1 (19-12-2023)

Identifiants

  • HAL Id : hal-04352340 , version 1

Citer

Souhaib Attaiki, Lei Li, Maks Ovsjanikov. Generalizable Local Feature Pre-training for Deformable Shape Analysis. CVPR 2023 - The IEEE/CVF Conference on Computer Vision and Pattern Recognition, Jun 2023, Vancouver, Canada. ⟨hal-04352340⟩
22 Consultations
11 Téléchargements

Partager

Gmail Facebook X LinkedIn More