Realistic Plant Modeling from Images Based on Analysis-by-Synthesis

Jérôme Guénard 1 Géraldine Morin 1 Frédéric Boudon 2, 3 Vincent Charvillat 1
2 VIRTUAL PLANTS - Modeling plant morphogenesis at different scales, from genes to phenotype
CRISAM - Inria Sophia Antipolis - Méditerranée , INRA - Institut National de la Recherche Agronomique, UMR AGAP - Amélioration génétique et adaptation des plantes méditerranéennes et tropicales
Abstract : Plants are essential elements of virtual worlds to get pleas- ant and realistic 3D environments. Even if mature computer vision techniques allow the reconstruction of challenging 3D objects from images, due to high complexity of plant topology, dedicated methods for generating 3D plant models must be devised. We propose an analysis-by- synthesis method which generates 3D models of a plant from both images and a priori knowledge of the plant species.Our method is based on a skeletonisation algorithm which allows to gen- erate a possible skeleton from a foliage segmentation. Then, a 3D generative model, based on a parametric model of branching systems that takes into account botanical knowledge is built. This method extends previous works by constraining the resulting skeleton to follow hierarchical organisation of natural branching structure. A first instance of a 3D model is generated. A reprojection of this model is compared with the original image. Then, we show that selecting the model from multiple proposals for the main branching structure of the plant and for the foliage improves the quality of the generated 3D model. Varying parameter values of the generative model, we produce a series of candidate models. A criterion based on comparing 3D virtual plant reprojection with original image selects the best model. Realistic results obtained on different species of plants illustrate the performance of the proposed method.
Document type :
Book sections
Complete list of metadatas

Cited literature [30 references]  Display  Hide  Download


https://hal.inria.fr/hal-01089744
Contributor : Christophe Godin <>
Submitted on : Wednesday, January 7, 2015 - 10:55:38 AM
Last modification on : Friday, June 14, 2019 - 6:31:06 PM
Long-term archiving on : Saturday, April 15, 2017 - 1:13:06 PM

Files

Guenard-curves_surfaces13.pdf
Files produced by the author(s)

Identifiers

Citation

Jérôme Guénard, Géraldine Morin, Frédéric Boudon, Vincent Charvillat. Realistic Plant Modeling from Images Based on Analysis-by-Synthesis. Floater, Michael and Lyche, Tom and Mazure, Marie-Laurence and Mørken, Knut and Schumaker, LarryL. Mathematical Methods for Curves and Surfaces, 8177, Springer-Verlag, pp.213-229, 2014, Lecture Notes in Computer Science, 978-3-642-54381-4. ⟨10.1007/978-3-642-54382-1_12⟩. ⟨hal-01089744⟩

Share

Metrics

Record views

860

Files downloads

543