Skip to Main content Skip to Navigation
New interface
Conference papers

Real-time interpretation of hand-drawn sketches with extended hierarchical bi-dimensional grammar

Abstract : This paper presents a generic method for eager interpretation of online hand-drawn sketches. This work takes place within the ACTIF project, with the objective of designing an e-learning system for geometry lessons in middle-schools. The goal is to analyze on the fly the child's inputs (using a pen-based interaction on tablet), and to give real-time feedback (visual, corrective, or guidance ones). We are therefore faced with the constraint of real-time strokes interpretation. We propose to use an incremental analysis process enabling to decrease the search space size. Nevertheless, we encounter combinatorial problems given the application field is complex. For example, create sub-figures from an existing one means the parser has to consider all possible combinations of connected segments that are contained in the original shape. To tackle this issue, we extend the definition and the parsing of bi-dimensional grammars by formalizing a hierarchy between production rules. Therefore, we propose alternative exploration strategies and reduce the search space of applicable production rules at any given level of the analysis. Thus, the parser is able to dynamically switch between the exploration strategies in the analysis process. The system has been tested with different drawing scenarios of geometric figures sketching. It reached interesting real-time performance, without loosing the generic aspect of the approach.
Complete list of metadata

Cited literature [12 references]  Display  Hide  Download
Contributor : omar krichen Connect in order to contact the contributor
Submitted on : Friday, November 9, 2018 - 5:42:11 PM
Last modification on : Friday, August 5, 2022 - 2:54:52 PM
Long-term archiving on: : Sunday, February 10, 2019 - 2:56:54 PM


Files produced by the author(s)


  • HAL Id : hal-01917888, version 1


Omar Krichen, Nathalie Girard, Eric Anquetil, Simon Corbillé, Mickaël Renault. Real-time interpretation of hand-drawn sketches with extended hierarchical bi-dimensional grammar. The 16th International Conference on Frontiers in Handwriting Recognition (ICFHR), Aug 2018, NIAGARA FALLS, United States. pp.273-278. ⟨hal-01917888⟩



Record views


Files downloads