Enhancing Energy Minimization Framework for Scene Text Recognition with Top-Down Cues - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Article Dans Une Revue Computer Vision and Image Understanding Année : 2016

Enhancing Energy Minimization Framework for Scene Text Recognition with Top-Down Cues

Résumé

Recognizing scene text is a challenging problem, even more so than the recognition of scanned documents. This problem has gained significant attention from the computer vision community in recent years, and several methods based on energy minimization frameworks and deep learning approaches have been proposed. In this work, we focus on the energy minimization framework and propose a model that exploits both bottom-up and top-down cues for recognizing cropped words extracted from street images. The bottom-up cues are derived from individual character detections from an image. We build a conditional random field model on these detections to jointly model the strength of the detections and the interactions between them. These interactions are top-down cues obtained from a lexicon-based prior, i.e., language statistics. The optimal word represented by the text image is obtained by minimizing the energy function corresponding to the random field model. We evaluate our proposed algorithm extensively on a number of cropped scene text benchmark datasets, namely Street View Text, ICDAR 2003, 2011 and 2013 datasets, and IIIT 5K-word, and show better performance than comparable methods. We perform a rigorous analysis of all the steps in our approach and analyze the results. We also show that state-of-the-art convolutional neural network features can be integrated in our framework to further improve the recognition performance.
Fichier principal
Vignette du fichier
mishraDraftRevised2.pdf (581.64 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-01263322 , version 1 (27-01-2016)

Identifiants

Citer

Anand Mishra, Karteek Alahari, C.V. Jawahar. Enhancing Energy Minimization Framework for Scene Text Recognition with Top-Down Cues. Computer Vision and Image Understanding, 2016, 145, pp.30-42. ⟨10.1016/j.cviu.2016.01.002⟩. ⟨hal-01263322⟩
263 Consultations
146 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More