O. Galibert, J. Kahn, and I. Oparin, The zonemap metric for page segmentation and area classification in scanned documents, ICIP, pp.2594-2598, 2014.

I. Oparin, J. Kahn, and O. Galibert, First maurdor 2013 evaluation campaign in scanned document image processing, ICASSP, pp.5090-5094, 2014.

A. Antonacopoulos, B. Gatos, and D. Karatzas, Icdar2003 page segmentation competition, pp.688-92, 2003.

M. D. Garris, Evaluating spatial correspondence of zones in document recognition systems, in ICIP, vol.3, pp.304-307, 1995.

C. Clausner, S. Pletschacher, and A. Antonacopoulos, Scenario driven in-depth performance evaluation of document layout analysis methods, ICDAR, pp.1404-1408, 2011.

F. Shafait, D. Keysers, and T. M. Breuel, Performance evaluation and benchmarking of six-page segmentation algorithms, PAMI, vol.30, issue.6, pp.941-954, 2008.

A. Antonacopoulos and D. Bridson, Performance analysis framework for layout analysis methods, ICDAR, vol.2, pp.1258-1262, 2007.

W. Seo, M. Agrawal, and D. Doermann, Performance evaluation tools for zone segmentation and classification (pets), ICPR, pp.503-506, 2010.

S. Randriamasy and L. Vincent, Benchmarking page segmentation algorithms, CVPR, pp.411-411, 1994.

J. Liang, T. I. Phillips, and R. M. Haralick, Performance evaluation of document structure extraction algorithms, Computer Vision and Image Understanding, vol.84, issue.1, pp.144-159, 2001.

F. Shafait, D. Keysers, and T. M. Breuel, Pixel-accurate representation and evaluation of page segmentation in document images, ICPR, vol.1, pp.872-875, 2006.

D. Lopresti and G. Wilfong, A fast technique for comparing graph representations with applications to performance evaluation, IJDAR, vol.6, issue.4, pp.219-229, 2003.

A. K. Dasand, S. K. Saha, and B. Chanda, An empirical measure of the performance of a document image segmentation algorithm, IJDAR, vol.4, issue.3, pp.183-190, 2002.

S. Mao and T. Kanungo, Empirical performance evaluation methodology and its application to page segmentation algorithms, PAMI, vol.23, issue.3, pp.242-256, 2001.

C. Wolf and J. M. Jolion, Object count/area graphs for the evaluation of object detection and segmentation algorithms, IJDAR, vol.8, issue.4, pp.280-296, 2006.
URL : https://hal.archives-ouvertes.fr/hal-01527427

M. Coteand and A. B. Albu, Layered ground truth: Conveying structural and statistical information for document image analysis and evaluation, ICPR, pp.3258-3263, 2016.

T. M. Breuel, The ocropus open source ocr system, DRR, vol.6815, p.68150, 2008.