Genetic Programming Based on Novelty Search

Enrique Naredo 1
1 CQFD - Quality control and dynamic reliability
IMB - Institut de Mathématiques de Bordeaux, Inria Bordeaux - Sud-Ouest
Résumé : Novelty Search (NS) is a unique approach towards search and optimization, where an explicit objective function is replaced by a measure of solution novelty. However, NS has been mostly used in evolutionary robotics, its usefulness in classic machine learning problems has been unexplored. This thesis presents a NS-based Genetic Programming (GP) algorithms for common machine learning problems, with the following contributions. It is shown that NS can solve real-world classification, clustering and symbolic regression tasks, validated on realworld benchmarks and synthetic problems. These results are made possible by using a domain-specific behavior descriptor, related to the concept of semantics in GP. Moreover, two new versions of the NS algorithm are proposed, Probabilistic NS (PNS) and a variant of Minimal Criteria NS (MCNS). The former models the behavior of each solution as a random vector and eliminates all the NS parameters while reducing the computational overhead of the NS algorithm; the latter uses a standard objective function to constrain and bias the search towards high performance solutions. The thesis also discusses the effects of NS on GP search dynamics and code growth. Results show that NS can be used as a realistic alternative for machine learning, and particularly for GP-based classification.
Document type :
Theses
Complete list of metadatas

Cited literature [160 references]  Display  Hide  Download

https://hal.inria.fr/tel-01668776
Contributor : Pierrick Legrand <>
Submitted on : Wednesday, December 20, 2017 - 11:57:31 AM
Last modification on : Thursday, January 11, 2018 - 6:22:12 AM

File

NaredoFINALThesis.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : tel-01668776, version 1

Collections

Citation

Enrique Naredo. Genetic Programming Based on Novelty Search. Artificial Intelligence [cs.AI]. ITT, Instituto tecnologico de Tijuana, 2016. English. ⟨tel-01668776⟩

Share

Metrics

Record views

189

Files downloads

301