MCGraph: Multi-criterion representation for scene understanding

Abstract : The field of scene understanding endeavours to extract a broad range of information from 3D scenes. Current approaches exploit one or at most a few different criteria (e.g., spatial, semantic, functional information) simultaneously for analysis. We argue that to take scene understanding to the next level of performance, we need to take into account many different, and possibly previously unconsidered types of knowledge simultaneously. A unified representation for this type of processing is as of yet missing. In this work we propose MCGraph: a unified multi-criterion data representation for understanding and processing of large-scale 3D scenes. Scene abstraction and prior knowledge are kept separated, but highly connected. For this purpose, primitives (i.e., proxies) and their relationships (e.g., contact, support, hierarchical) are stored in an abstraction graph, while the different categories of prior knowledge necessary for processing are stored separately in a knowledge graph. These graphs complement each other bidirectionally, and are processed concurrently. We illustrate our approach by expressing previous techniques using our formulation, and present promising avenues of research opened up by using such a representation. We also distribute a set of MCGraph annotations for a small number of NYU2 scenes, to be used as ground truth multi-criterion abstractions.
Type de document :
Communication dans un congrès
SIGGRAPH Asia 2014 Indoor Scene Understanding Where Graphics Meets Vision, Dec 2014, Shenzhen, China. pp.1 - 9, 2014, 〈10.1145/2670291.2670292〉
Liste complète des métadonnées

Littérature citée [65 références]  Voir  Masquer  Télécharger


https://hal.inria.fr/hal-01498281
Contributeur : Nicolas Mellado <>
Soumis le : mercredi 29 mars 2017 - 17:39:11
Dernière modification le : vendredi 28 avril 2017 - 01:05:14
Document(s) archivé(s) le : vendredi 30 juin 2017 - 17:12:27

Fichiers

mcgraph.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Collections

Citation

Moos Hueting, Aron Monszpart, Nicolas Mellado. MCGraph: Multi-criterion representation for scene understanding. SIGGRAPH Asia 2014 Indoor Scene Understanding Where Graphics Meets Vision, Dec 2014, Shenzhen, China. pp.1 - 9, 2014, 〈10.1145/2670291.2670292〉. 〈hal-01498281〉

Partager

Métriques

Consultations de la notice

60

Téléchargements de fichiers

25