Real-time interpretation of hand-drawn sketches with extended hierarchical bi-dimensional grammar - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2018

Real-time interpretation of hand-drawn sketches with extended hierarchical bi-dimensional grammar

Résumé

This paper presents a generic method for eager interpretation of online hand-drawn sketches. This work takes place within the ACTIF project, with the objective of designing an e-learning system for geometry lessons in middle-schools. The goal is to analyze on the fly the child's inputs (using a pen-based interaction on tablet), and to give real-time feedback (visual, corrective, or guidance ones). We are therefore faced with the constraint of real-time strokes interpretation. We propose to use an incremental analysis process enabling to decrease the search space size. Nevertheless, we encounter combinatorial problems given the application field is complex. For example, create sub-figures from an existing one means the parser has to consider all possible combinations of connected segments that are contained in the original shape. To tackle this issue, we extend the definition and the parsing of bi-dimensional grammars by formalizing a hierarchy between production rules. Therefore, we propose alternative exploration strategies and reduce the search space of applicable production rules at any given level of the analysis. Thus, the parser is able to dynamically switch between the exploration strategies in the analysis process. The system has been tested with different drawing scenarios of geometric figures sketching. It reached interesting real-time performance, without loosing the generic aspect of the approach.
Fichier principal
Vignette du fichier
ICFHR_FINAL_CAMERA_READY.pdf (651.2 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01917888 , version 1 (09-11-2018)

Identifiants

  • HAL Id : hal-01917888 , version 1

Citer

Omar Krichen, Nathalie Girard, Eric Anquetil, Simon Corbillé, Mickaël Renault. Real-time interpretation of hand-drawn sketches with extended hierarchical bi-dimensional grammar. The 16th International Conference on Frontiers in Handwriting Recognition (ICFHR), Aug 2018, NIAGARA FALLS, United States. pp.273-278. ⟨hal-01917888⟩
243 Consultations
235 Téléchargements

Partager

Gmail Facebook X LinkedIn More