Auto-encoding meshes of any topology with the current-splatting and exponentiation layers

Alexandre Bône 1 Olivier Colliot 1 Stanley Durrleman 1
1 ARAMIS - Algorithms, models and methods for images and signals of the human brain
SU - Sorbonne Université, Inria de Paris, ICM - Institut du Cerveau et de la Moëlle Epinière = Brain and Spine Institute
Abstract : Deep learning has met key applications in image computing, but still lacks processing paradigms for meshes, i.e. collections of elementary geometrical parts such as points, segments or triangles. Meshes are both a powerful representation for geometrical objects, and a challenge for network architectures because of their inherent irregular structure. This work contributes to adapt classical deep learning paradigms to this particular type of data in three ways. First, we introduce the current-splatting layer which embeds meshes in a metric space, allowing the downstream network to process them without any assumption on their topology: they may be composed of varied numbers of elements or connected components, contain holes, or bear high levels of geometrical noise. Second, we adapt to meshes the exponentiation layer which, from an upstream image array, generates shapes with a diffeomorphic control over their topology. Third, we take advantage of those layers to devise a variational auto-encoding architecture, which we interpret as a generative statistical model that learns adapted low-dimensional representations for mesh data sets. An explicit norm-control layer ensures the correspondence between the latent-space Euclidean metric and the shape-space log-Euclidean one. We illustrate this method on simulated and real data sets, and show the practical relevance of the learned representation for visualization, classification and mesh synthesis.
Complete list of metadatas

Cited literature [20 references]  Display  Hide  Download

https://hal.inria.fr/hal-02087586
Contributor : Alexandre Bône <>
Submitted on : Tuesday, April 2, 2019 - 11:19:48 AM
Last modification on : Tuesday, April 30, 2019 - 3:43:42 PM
Long-term archiving on : Wednesday, July 3, 2019 - 2:11:27 PM

File

ICCV_2019.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-02087586, version 1

Citation

Alexandre Bône, Olivier Colliot, Stanley Durrleman. Auto-encoding meshes of any topology with the current-splatting and exponentiation layers. 2019. ⟨hal-02087586⟩

Share

Metrics

Record views

131

Files downloads

203