Statistic Metrics for Evaluation of Binary Classifiers without Ground-Truth

Abstract : In this paper, are presented a number of statistically grounded performance evaluation metrics capable of evaluating binary classifiers in absence of annotated Ground Truth. These metrics are generic and can be applied to any type of classifier but are experimentally validated on binarization algorithms. The statistically grounded metrics were applied and compared with metrics based on annotated data. This approach has statistically significant better than random results in classifiers selection, and our evaluation metrics requiring no Ground Truth have high correlation with traditional metrics. The experiments were conducted on the images from the DIBCO binarization contests between 2009 and 2013.
Complete list of metadatas

https://hal.inria.fr/hal-01563615
Contributor : Bart Lamiroy <>
Submitted on : Monday, July 17, 2017 - 8:50:06 PM
Last modification on : Tuesday, December 18, 2018 - 4:38:02 PM
Long-term archiving on : Saturday, January 27, 2018 - 1:55:51 AM

File

UKRCON-2017_Doc_or_Tex_Paper_2...
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01563615, version 1

Citation

Maksym Fedorchuk, Bart Lamiroy. Statistic Metrics for Evaluation of Binary Classifiers without Ground-Truth. IEEE First Ukraine Conference on Electrical and Computer Engineering (UKRCON) , May 2017, Kiev, Ukraine. ⟨hal-01563615⟩

Share

Metrics

Record views

350

Files downloads

266