Incremental Data-driven Learning of a Novelty Detection Model for One-Class Classification with Application to High-Dimensional Noisy Data

Randa Kassab 1 Frédéric Alexandre 1
1 CORTEX - Neuromimetic intelligence
INRIA Lorraine, LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications
Abstract : Most conventional learning algorithms require both positive and negative training data for achieving accurate classification results. However, the problem of learning classifiers from only positive data arises in many applications where negative data are too costly, difficult to obtain, or not available at all. This paper describes a new machine learning approach, called ILoNDF (Incremental data-driven Learning of Novelty Detector Filter). The approach is inspired by novelty detection theory and its learning method, which typically requires only examples from one class to learn a model. One advantage of ILoNDF is the ability of its generative learning to capture the intrinsic characteristics of the training data by continuously integrating the information relating to the relative frequencies of the features of training data and their co-occurrence dependencies. This makes ILoNDF rather stable and less sensitive to noisy features which may be present in the representation of the positive data. In addition, ILoNDF does not require extensive computational resources since it operates on-line without repeated training, and no parameters need to be tuned. In this study we mainly focus on the robustness of ILoNDF in dealing with high-dimensional noisy data and we investigate the variation of its performance depending on the amount of data available for training. To make our study comparable to previous studies, we investigate four common methods: PCA residuals, Hotelling's T2 test, an auto-associative neural network, and a one-class version of the SVM classifier (lately a favored method for one-class classification). Experiments are conducted on two real-world text corpora: Reuters and WebKB. Results show that ILoNDF tends to be more robust, is less affected by initial settings, and consistently outperforms the other methods.
Type de document :
Article dans une revue
Machine Learning, Springer Verlag, 2009, 74 (2), pp.191-234
Liste complète des métadonnées

https://hal.inria.fr/inria-00337973
Contributeur : Randa Kassab <>
Soumis le : lundi 10 novembre 2008 - 11:54:43
Dernière modification le : jeudi 11 janvier 2018 - 06:19:48

Identifiants

  • HAL Id : inria-00337973, version 1

Collections

Citation

Randa Kassab, Frédéric Alexandre. Incremental Data-driven Learning of a Novelty Detection Model for One-Class Classification with Application to High-Dimensional Noisy Data. Machine Learning, Springer Verlag, 2009, 74 (2), pp.191-234. 〈inria-00337973〉

Partager

Métriques

Consultations de la notice

285