Skip to Main content Skip to Navigation
Journal articles

Random Partitioning Forest for Point-Wise and Collective Anomaly Detection - Application to Network Intrusion Detection

Abstract : In this paper, we propose DiFF-RF, an ensemble approach composed of random partitioning binary trees to detect point-wise and collective (as well as contextual) anomalies. Thanks to a distance-based paradigm used at the leaves of the trees, this semi-supervised approach solves a drawback that has been identified in the isolation forest (IF) algorithm. Moreover, taking into account the frequencies of visits in the leaves of the random trees allows to significantly improve the performance of DiFF-RF when considering the presence of collective anomalies. DiFF-RF is fairly easy to train, and excellent performance can be obtained by using a simple semi-supervised procedure to setup the extra hyper-parameter that is introduced. We first evaluate DiFF-RF on a synthetic data set to i) verify that the limitation of the IF algorithm is overcome, ii) demonstrate how collective anomalies are actually detected and iii) to analyze the effect of the meta-parameters it involves. We assess the DiFF-RF algorithm on a large set of datasets from the UCI repository, as well as two benchmarks related to intrusion detection applications. Our experiments show that DiFF-RF almost systematically outperforms the IF algorithm, but also challenges the one-class SVM baseline and a deep learning variational auto-encoder architecture. Furthermore, our experience shows that DiFF-RF can work well in the presence of small-scale learning data, which is conversely difficult for deep neural architectures. Finally, DiFF-RF is computationally efficient and can be easily parallelized on multi-core architectures.
Complete list of metadatas

https://hal.archives-ouvertes.fr/hal-02882548
Contributor : Pierre-François Marteau <>
Submitted on : Wednesday, January 13, 2021 - 10:43:11 AM
Last modification on : Friday, January 15, 2021 - 3:29:55 AM

Files

DiFF-RF-v3.pdf
Files produced by the author(s)

Identifiers

Citation

Pierre-François Marteau. Random Partitioning Forest for Point-Wise and Collective Anomaly Detection - Application to Network Intrusion Detection. IEEE Transactions on Information Forensics and Security, Institute of Electrical and Electronics Engineers, In press, pp.1-16. ⟨10.1109/TIFS.2021.3050605⟩. ⟨hal-02882548v2⟩

Share

Metrics

Record views

27

Files downloads

11