Enhancing Energy Minimization Framework for Scene Text Recognition with Top-Down Cues

Abstract : Recognizing scene text is a challenging problem, even more so than the recognition of scanned documents. This problem has gained significant attention from the computer vision community in recent years, and several methods based on energy minimization frameworks and deep learning approaches have been proposed. In this work, we focus on the energy minimization framework and propose a model that exploits both bottom-up and top-down cues for recognizing cropped words extracted from street images. The bottom-up cues are derived from individual character detections from an image. We build a conditional random field model on these detections to jointly model the strength of the detections and the interactions between them. These interactions are top-down cues obtained from a lexicon-based prior, i.e., language statistics. The optimal word represented by the text image is obtained by minimizing the energy function corresponding to the random field model. We evaluate our proposed algorithm extensively on a number of cropped scene text benchmark datasets, namely Street View Text, ICDAR 2003, 2011 and 2013 datasets, and IIIT 5K-word, and show better performance than comparable methods. We perform a rigorous analysis of all the steps in our approach and analyze the results. We also show that state-of-the-art convolutional neural network features can be integrated in our framework to further improve the recognition performance.
Type de document :
Article dans une revue
Computer Vision and Image Understanding, Elsevier, 2016, 145, pp.30-42. <10.1016/j.cviu.2016.01.002>
Liste complète des métadonnées

https://hal.inria.fr/hal-01263322
Contributeur : Karteek Alahari <>
Soumis le : mercredi 27 janvier 2016 - 16:24:05
Dernière modification le : vendredi 16 décembre 2016 - 11:52:15
Document(s) archivé(s) le : jeudi 28 avril 2016 - 11:22:09

Fichier

mishraDraftRevised2.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Collections

Citation

Anand Mishra, Karteek Alahari, C.V. Jawahar. Enhancing Energy Minimization Framework for Scene Text Recognition with Top-Down Cues. Computer Vision and Image Understanding, Elsevier, 2016, 145, pp.30-42. <10.1016/j.cviu.2016.01.002>. <hal-01263322>

Partager

Métriques

Consultations de
la notice

257

Téléchargements du document

83