Learning to detect, localize and recognize many text objects in document images from few examples

Bastien Moysset 1, 2 Christopher Kermorvant 2 Christian Wolf 1
1 imagine - Extraction de Caractéristiques et Identification
LIRIS - Laboratoire d'InfoRmatique en Image et Systèmes d'information
2 A2iA - A2iA
Abstract : The current trend in object detection and localization is to learn predictions with high capacity deep neural networks trained on a very large amount of annotated data and using a high amount of processing power. In this work, we particularly target the detection of text in document images and we propose a new neural model which directly predicts object coordinates. The particularity of our contribution lies in the local computations of predictions with a new form of local parameter sharing which keeps the overall amount of trainable parameters low. Key components of the model are spatial 2D-LSTM recurrent layers which convey contextual information between the regions of the image. We show that this model is more powerful than the state of the art in applications where training data are not as abundant as in the classical configuration of natural images and Imagenet/Pascal-VOC tasks. The proposed model also facilitates the detection of many objects in a single image and can deal with inputs of variable sizes without resizing. To enhance the localization precision of the coordinate regressor, we limit the amount of information produced by the local model components and propose two different regression strategies: (i) separately predict lower-left and upper-right corners of each object bounding box, followed by combinatorial pairing; (ii) only predict the left side of the objects and estimate the right position jointly with text recognition. These strategies lead to good full-page text recognition results in heterogeneous documents. Experiments have been performed on a document analysis task, the localization of the text lines in the Maurdor dataset.
Keywords : Recurrent Neural network Text line detection Document analysis Local Regression
Document type :
Journal articles
Complete list of metadatas
https://hal.inria.fr/hal-01800636
Contributor : Christian Wolf <>
Submitted on : Sunday, May 27, 2018 - 12:35:01 PM
Last modification on : Thursday, November 21, 2019 - 2:05:19 AM

Identifiers

Collections

CNRS | EC-LYON | UNIV-LYON2 | UNIV-LYON1 | INSA-LYON | LIRIS | INSA-GROUPE | LABEXIMU | UDL

Citation

Bastien Moysset, Christopher Kermorvant, Christian Wolf. Learning to detect, localize and recognize many text objects in document images from few examples. International Journal on Document Analysis and Recognition, Springer Verlag, In press, ⟨10.1007/s10032-018-0305-2⟩. ⟨hal-01800636⟩

Export

BibTeX TEI DC DCterms EndNote

Share

Metrics

Record views

383

 

 

Contact

archive-ouverte@inria.fr