Real-time 2D manipulation of plausible 3D appearance using shading and geometry buffers

Carlos J. Zubiaga 1
1 MANAO - Melting the frontiers between Light, Shape and Matter
LaBRI - Laboratoire Bordelais de Recherche en Informatique, Inria Bordeaux - Sud-Ouest, LP2N - Laboratoire Photonique, Numérique et Nanosciences
Abstract : Traditional artists paint directly on a canvas and create plausible appearances of real-world scenes. In contrast, Computer Graphics artists define objects on a virtual scene (3D meshes, materials and light sources), and use complex algorithms (rendering) to reproduce their appearance. On the one hand, painting techniques permit to freely define appearance. On the other hand, rendering techniques permit to modify separately and dynamically the different elements that compose the scene. In this thesis we present a middle-ground approach to manipulate appearance. We offer 3D-like manipulation abilities while working on the 2D space. We first study the impact on shading of materials as band-pass filters of lighting. We present a small set of local statistical relationships between material/lighting and shading. These relationships are used to mimic modifications on material or lighting from an artist-created image of a sphere. Techniques known as LitSpheres/MatCaps use these kinds of images to transfer their appearance to arbitrary-shaped objects. Our technique proves the possibility to mimic 3D-like modifications of light and material from an input artwork in 2D. We present a different technique to modify the third element involved on the visual appearance of an object: its geometry. In this case we use as input rendered images alongside with 3D information of the scene output in so-called auxiliary buffers. We are able to recover geometry-independent shading for each object surface, assuming no spatial variations for each recovered surface. The recovered shading can be used to modify arbitrarily the local shape of the object interactively without the need to re-render the scene.
Document type :
Complete list of metadatas
Contributor : Carlos J. Zubiaga <>
Submitted on : Thursday, January 19, 2017 - 6:08:36 PM
Last modification on : Wednesday, July 25, 2018 - 1:24:20 AM
Long-term archiving on : Thursday, April 20, 2017 - 1:59:11 PM


Distributed under a Creative Commons Public Domain Mark 4.0 International License


  • HAL Id : tel-01440828, version 1


Carlos J. Zubiaga. Real-time 2D manipulation of plausible 3D appearance using shading and geometry buffers. Graphics [cs.GR]. Université de Bordeaux, 2016. English. ⟨tel-01440828⟩



Record views


Files downloads