Skip to Main content Skip to Navigation
Conference papers

Stream-based Active Learning in the Presence of Label Noise

Mohamed-Rafik Bouguelia 1 Yolande Belaïd 1 Abdel Belaïd 1
1 READ - Recognition of writing and analysis of documents
LORIA - NLPKD - Department of Natural Language Processing & Knowledge Discovery
Abstract : Mislabelling is a critical problem for stream-based active learning methods because it not only impacts the classification accuracy but also deviates the active learner from querying informative data. Dealing with label noise is omitted by most existing active learning methods. We address this issue and propose an efficient method to identify and mitigate mislabelling errors for active learning in the streaming setting. We first propose a mislabelling likelihood measure to characterize the potentially mislabelled instances. This measure is based on the degree of disagreement among the predicted and the queried class label (given by the labeller). Then, we derive a measure of informativeness that expresses how much the label of an instance needs to be corrected by an expert labeller. Specifically, an instance is worth relabelling if it shows highly conflicting information among the predicted and the queried labels. We show that filtering instances with a high mislabelling likelihood and correcting only the filtered instances with a high conflicting information greatly improves the performances of the active learner. Experiments on several real world data prove the effectiveness of the proposed method in terms of filtering efficiency and classification accuracy of the stream-based active learner.
Complete list of metadata

Cited literature [21 references]  Display  Hide  Download

https://hal.inria.fr/hal-01116114
Contributor : Yolande Belaid <>
Submitted on : Thursday, February 12, 2015 - 3:32:46 PM
Last modification on : Friday, January 15, 2021 - 5:42:02 PM
Long-term archiving on: : Sunday, April 16, 2017 - 8:29:31 AM

File

version_editeur.pdf
Publisher files allowed on an open archive

Identifiers

Collections

Citation

Mohamed-Rafik Bouguelia, Yolande Belaïd, Abdel Belaïd. Stream-based Active Learning in the Presence of Label Noise. 4th International Conference on Pattern Recognition Applications and Methods - ICPRAM 2015, Jan 2015, Lisbon, Portugal. pp.25 - 34, ⟨10.5220/0005178900250034⟩. ⟨hal-01116114⟩

Share

Metrics

Record views

476

Files downloads

2139