Decomposing intensity gradients into information about shape and material

Pascal Barla 1, 2, 3 Romain Vergne 4 Roland Fleming 5
3 MANAO - Melting the frontiers between Light, Shape and Matter
LaBRI - Laboratoire Bordelais de Recherche en Informatique, Inria Bordeaux - Sud-Ouest, LP2N - Laboratoire Photonique, Numérique et Nanosciences
4 MAVERICK - Models and Algorithms for Visualization and Rendering
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
Abstract : Recent work has shown that the perception of 3D shapes, material properties and illumination are inter-dependent, although for practical reasons, each set of experiments has probed these three causal factors independently. Most of these studies share a common observation though: that variations in image intensity (both their magnitude and direction) play a central role in estimating the physical properties of objects and illumination. Our aim is to separate retinal image intensity gradients into contributions of different shape and material properties, through a theoretical analysis of image formation. We find that gradients can be understood as the sum of three terms: variations of surface depth conveyed through surface-varying reflectance and near-field illumination effects (shadows and inter-reflections); variations of surface orientation conveyed through reflections and far-field lighting effects; and variations of surface micro-structures conveyed through anisotropic reflections. We believe our image gradient decomposition constitutes a solid and novel basis for perceptual inquiry. We first illustrate each of these terms with synthetic 3D scenes rendered with global illumination. We then show that it is possible to mimic the visual appearance of shading and reflections directly in the image, by distorting patterns in 2D. Finally, we discuss the consistency of our mathematical relations with observations drawn by recent perceptual experiments, including the perception of shape from specular reflections and texture. In particular, we show that the analysis can correctly predict certain specific illusions of both shape and material.
Complete list of metadatas
Contributor : Pascal Barla <>
Submitted on : Monday, October 7, 2013 - 5:25:18 PM
Last modification on : Tuesday, May 14, 2019 - 10:44:05 AM

Links full text



Pascal Barla, Romain Vergne, Roland Fleming. Decomposing intensity gradients into information about shape and material. Journal of Vision, Association for Research in Vision and Ophthalmology, 2013, Vision Sciences Society Meeting, 2013: Abstracts, 13 (9), pp.article 443. ⟨10.1167/13.9.443⟩. ⟨hal-00851908⟩



Record views