Skip to Main content Skip to Navigation
Journal articles

Lifting Freehand Concept Sketches into 3D

Abstract : We present the first algorithm capable of automatically lifting real-world, vector-format, industrial design sketches into 3D. Targeting real-world sketches raises numerous challenges due to inaccuracies, use of overdrawn strokes, and construction lines. In particular, while construction lines convey important 3D information, they add significant clutter and introduce multiple accidental 2D intersections. Our algorithm exploits the geometric cues provided by the construction lines and lifts them to 3D by computing their intended 3D intersections and depths. Once lifted to 3D, these lines provide valuable geometric constraints that we leverage to infer the 3D shape of other artist drawn strokes. The core challenge we address is inferring the 3D connectivity of construction and other lines from their 2D projections by separating 2D intersections into 3D intersections and accidental occlusions. We efficiently address this complex combinatorial problem using a dedicated search algorithm that leverages observations about designer drawing preferences , and uses those to explore only the most likely solutions of the 3D intersection detection problem. We demonstrate that our separator outputs are of comparable quality to human annotations, and that the 3D structures we recover enable a range of design editing and visualization applications, including novel view synthesis and 3D-aware scaling of the depicted shape.
Complete list of metadatas

Cited literature [48 references]  Display  Hide  Download

https://hal.inria.fr/hal-02952509
Contributor : Team Reves <>
Submitted on : Tuesday, September 29, 2020 - 2:06:41 PM
Last modification on : Wednesday, September 30, 2020 - 3:28:52 AM

File

LiftingSketches.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Yulia Gryaditskaya, Felix Hähnlein, Chenxi Liu, Alla Sheffer, Adrien Bousseau. Lifting Freehand Concept Sketches into 3D. ACM Transactions on Graphics, Association for Computing Machinery, 2020, Proceedings of SIGGRAPH Asia, ⟨10.1145/3414685.3417851⟩. ⟨hal-02952509⟩

Share

Metrics

Record views

58

Files downloads

207