Skip to Main content Skip to Navigation
Conference papers

Filtering Outliers in One Step with Genetic Programming

Abstract : Outliers are one of the most difficult issues when dealing with real-world modeling tasks. Even a small percentage of outliers can impede a learning algorithm’s ability to fit a dataset. While robust regression algorithms exist, they fail when a dataset is corrupted by more than 50% of outliers (breakdown point). In the case of Genetic Programming, robust regression has not been properly studied. In this paper we present a method that works as a filter, removing outliers from the target variable (vertical outliers). The algorithm is simple, it uses a randomly generated population of GP trees to determine which target values should be labeled as outliers. The method is highly efficient. Results show that it can return a clean dataset when contamination reaches as high as 90%, and may be able to handle higher levels of contamination. In this study only synthetic univariate benchmarks are used to evaluate the approach, but it must be stressed that no other approaches can deal with such high levels of outlier contamination while requiring such small computational effort.
Complete list of metadata

https://hal.inria.fr/hal-01910433
Contributor : Pierrick Legrand Connect in order to contact the contributor
Submitted on : Wednesday, October 31, 2018 - 9:48:26 PM
Last modification on : Saturday, December 4, 2021 - 3:43:34 AM

Identifiers

Collections

Citation

Uriel Lopez, Leonardo Trujillo, Pierrick Legrand. Filtering Outliers in One Step with Genetic Programming. PPSN 2018 - Fifteenth International Conference on Parallel Problem Solving from Nature (PPSN XV), Sep 2018, Coimbra, Portugal. ⟨10.1007/978-3-319-99253-2_17⟩. ⟨hal-01910433⟩

Share

Metrics

Les métriques sont temporairement indisponibles