Skip to Main content Skip to Navigation
Conference papers

MCGraph: Multi-criterion representation for scene understanding

Abstract : The field of scene understanding endeavours to extract a broad range of information from 3D scenes. Current approaches exploit one or at most a few different criteria (e.g., spatial, semantic, functional information) simultaneously for analysis. We argue that to take scene understanding to the next level of performance, we need to take into account many different, and possibly previously unconsidered types of knowledge simultaneously. A unified representation for this type of processing is as of yet missing. In this work we propose MCGraph: a unified multi-criterion data representation for understanding and processing of large-scale 3D scenes. Scene abstraction and prior knowledge are kept separated, but highly connected. For this purpose, primitives (i.e., proxies) and their relationships (e.g., contact, support, hierarchical) are stored in an abstraction graph, while the different categories of prior knowledge necessary for processing are stored separately in a knowledge graph. These graphs complement each other bidirectionally, and are processed concurrently. We illustrate our approach by expressing previous techniques using our formulation, and present promising avenues of research opened up by using such a representation. We also distribute a set of MCGraph annotations for a small number of NYU2 scenes, to be used as ground truth multi-criterion abstractions.
Document type :
Conference papers
Complete list of metadatas

Cited literature [59 references]  Display  Hide  Download


https://hal.inria.fr/hal-01498281
Contributor : Nicolas Mellado <>
Submitted on : Wednesday, March 29, 2017 - 5:39:11 PM
Last modification on : Wednesday, May 22, 2019 - 10:44:05 AM
Document(s) archivé(s) le : Friday, June 30, 2017 - 5:12:27 PM

Files

mcgraph.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Moos Hueting, Aron Monszpart, Nicolas Mellado. MCGraph: Multi-criterion representation for scene understanding. SIGGRAPH Asia 2014 Indoor Scene Understanding Where Graphics Meets Vision, Dec 2014, Shenzhen, China. pp.1 - 9, ⟨10.1145/2670291.2670292⟩. ⟨hal-01498281⟩

Share

Metrics

Record views

97

Files downloads

309